2024-04-17T02:10:33.163 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-17T02:10:33.163 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --description rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{centos_latest} tasks/workunits} --name yuriw-2024-04-16_23:25:35-rados-wip-yuriw-testing-20240416.150233-distro-default-smithi --archive /home/teuthworker/archive/yuriw-2024-04-16_23:25:35-rados-wip-yuriw-testing-20240416.150233-distro-default-smithi/7659500 --verbose -- /home/teuthworker/archive/yuriw-2024-04-16_23:25:35-rados-wip-yuriw-testing-20240416.150233-distro-default-smithi/7659500/orig.config.yaml 2024-04-17T02:10:33.194 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T02:10:33.281 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-04-16_23:25:35-rados-wip-yuriw-testing-20240416.150233-distro-default-smithi/7659500 branch: wip-yuriw-testing-20240416.150233 description: rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{centos_latest} tasks/workunits} email: yweinste@redhat.com first_in_suite: false job_id: '7659500' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2024-04-16_23:25:35-rados-wip-yuriw-testing-20240416.150233-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 2 size: 30 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuriw-testing-20240416.150233 ceph: conf: client: debug client: 20 debug mgrc: 20 debug ms: 1 global: mon election default strategy: 3 mds: debug mgrc: 20 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mgr ttl cache expire seconds: 5 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug mgrc: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 687eba7a6534970dd256b49bc87e74b01871539e ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 687eba7a6534970dd256b49bc87e74b01871539e selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuriw-testing-20240416.150233 sha1: 687eba7a6534970dd256b49bc87e74b01871539e owner: scheduled_yuriw@teuthology priority: 99 repo: https://github.com/ceph/ceph-ci.git roles: - - mgr.x - mon.a - mon.c - mds.a - mds.c - osd.0 - client.0 - - mgr.y - mgr.z - mon.b - mds.b - osd.1 - osd.2 - osd.3 - client.1 seed: 2282 sha1: 687eba7a6534970dd256b49bc87e74b01871539e sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuriw-testing-20240416.150233 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_687eba7a6534970dd256b49bc87e74b01871539e/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 687eba7a6534970dd256b49bc87e74b01871539e targets: smithi017.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKw7DNo7DRsd3smle4Eo4f0gzEt4yiQ7NaTitvSCxO1W0NupsW+/sORRdfQ50XC4l2HwRUefFhZi/aALKehqEMg= smithi122.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPLT+tXeF7lbvd5wFtDB0xF+4ogVq6HNLgbzducVjtjk6pVbxlD3LGMQpj2oJq6/cg/NpFFsGyzNxPKonVWE17U= tasks: - install: null - ceph: log-ignorelist: - overall HEALTH_ - \(MGR_DOWN\) - \(PG_ - replacing it with standby - No standby daemons available - \(POOL_APP_NOT_ENABLED\) wait-for-scrub: false - workunit: clients: client.0: - mgr/test_localpool.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 6c637841c215537a4502385240412f1966e0faab timestamp: 2024-04-16_23:25:35 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-17T02:10:33.281 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_687eba7a6534970dd256b49bc87e74b01871539e/qa; will attempt to use it 2024-04-17T02:10:33.282 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_687eba7a6534970dd256b49bc87e74b01871539e/qa/tasks 2024-04-17T02:10:33.282 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-17T02:10:33.284 INFO:teuthology.task.internal:Checking packages... 2024-04-17T02:10:33.309 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '687eba7a6534970dd256b49bc87e74b01871539e' 2024-04-17T02:10:33.309 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-17T02:10:33.309 INFO:teuthology.packaging:ref: None 2024-04-17T02:10:33.309 INFO:teuthology.packaging:tag: None 2024-04-17T02:10:33.309 INFO:teuthology.packaging:branch: wip-yuriw-testing-20240416.150233 2024-04-17T02:10:33.309 INFO:teuthology.packaging:sha1: 687eba7a6534970dd256b49bc87e74b01871539e 2024-04-17T02:10:33.310 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuriw-testing-20240416.150233 2024-04-17T02:10:33.454 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2311.g687eba7a 2024-04-17T02:10:33.455 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-17T02:10:33.462 INFO:teuthology.task.internal:no buildpackages task found 2024-04-17T02:10:33.462 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-17T02:10:33.479 INFO:teuthology.task.internal:Saving configuration 2024-04-17T02:10:33.491 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-17T02:10:33.499 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-17T02:10:33.525 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-04-16_23:25:35-rados-wip-yuriw-testing-20240416.150233-distro-default-smithi/7659500', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-17 02:05:31.123398', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKw7DNo7DRsd3smle4Eo4f0gzEt4yiQ7NaTitvSCxO1W0NupsW+/sORRdfQ50XC4l2HwRUefFhZi/aALKehqEMg='} 2024-04-17T02:10:33.549 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi122.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-04-16_23:25:35-rados-wip-yuriw-testing-20240416.150233-distro-default-smithi/7659500', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-17 02:05:31.121998', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPLT+tXeF7lbvd5wFtDB0xF+4ogVq6HNLgbzducVjtjk6pVbxlD3LGMQpj2oJq6/cg/NpFFsGyzNxPKonVWE17U='} 2024-04-17T02:10:33.549 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-17T02:10:33.555 INFO:teuthology.task.internal:roles: ubuntu@smithi017.front.sepia.ceph.com - ['mgr.x', 'mon.a', 'mon.c', 'mds.a', 'mds.c', 'osd.0', 'client.0'] 2024-04-17T02:10:33.555 INFO:teuthology.task.internal:roles: ubuntu@smithi122.front.sepia.ceph.com - ['mgr.y', 'mgr.z', 'mon.b', 'mds.b', 'osd.1', 'osd.2', 'osd.3', 'client.1'] 2024-04-17T02:10:33.555 INFO:teuthology.run_tasks:Running task console_log... 2024-04-17T02:10:33.637 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd453e24f70>, signals=[15]) 2024-04-17T02:10:33.637 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-17T02:10:33.646 INFO:teuthology.task.internal:Opening connections... 2024-04-17T02:10:33.646 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi017.front.sepia.ceph.com 2024-04-17T02:10:33.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T02:10:33.796 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi122.front.sepia.ceph.com 2024-04-17T02:10:33.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T02:10:33.929 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-17T02:10:33.935 DEBUG:teuthology.orchestra.run.smithi017:> uname -m 2024-04-17T02:10:33.954 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2024-04-17T02:10:33.954 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2024-04-17T02:10:34.012 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream" 2024-04-17T02:10:34.012 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="9" 2024-04-17T02:10:34.012 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos" 2024-04-17T02:10:34.013 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora" 2024-04-17T02:10:34.013 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="9" 2024-04-17T02:10:34.013 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el9" 2024-04-17T02:10:34.014 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T02:10:34.014 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2024-04-17T02:10:34.014 INFO:teuthology.orchestra.run.smithi017.stdout:LOGO="fedora-logo-icon" 2024-04-17T02:10:34.014 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T02:10:34.014 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/" 2024-04-17T02:10:34.014 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T02:10:34.014 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T02:10:34.014 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T02:10:34.015 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2024-04-17T02:10:34.043 DEBUG:teuthology.orchestra.run.smithi122:> uname -m 2024-04-17T02:10:34.060 INFO:teuthology.orchestra.run.smithi122.stdout:x86_64 2024-04-17T02:10:34.060 DEBUG:teuthology.orchestra.run.smithi122:> cat /etc/os-release 2024-04-17T02:10:34.116 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="CentOS Stream" 2024-04-17T02:10:34.116 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="9" 2024-04-17T02:10:34.116 INFO:teuthology.orchestra.run.smithi122.stdout:ID="centos" 2024-04-17T02:10:34.116 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE="rhel fedora" 2024-04-17T02:10:34.116 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="9" 2024-04-17T02:10:34.117 INFO:teuthology.orchestra.run.smithi122.stdout:PLATFORM_ID="platform:el9" 2024-04-17T02:10:34.117 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T02:10:34.117 INFO:teuthology.orchestra.run.smithi122.stdout:ANSI_COLOR="0;31" 2024-04-17T02:10:34.117 INFO:teuthology.orchestra.run.smithi122.stdout:LOGO="fedora-logo-icon" 2024-04-17T02:10:34.117 INFO:teuthology.orchestra.run.smithi122.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T02:10:34.117 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://centos.org/" 2024-04-17T02:10:34.117 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T02:10:34.117 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T02:10:34.117 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T02:10:34.117 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server 2024-04-17T02:10:34.142 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-17T02:10:34.151 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-17T02:10:34.169 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-17T02:10:34.169 DEBUG:teuthology.orchestra.run.smithi017:> test '!' -e /home/ubuntu/cephtest 2024-04-17T02:10:34.172 DEBUG:teuthology.orchestra.run.smithi122:> test '!' -e /home/ubuntu/cephtest 2024-04-17T02:10:34.188 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-17T02:10:34.195 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-17T02:10:34.195 DEBUG:teuthology.orchestra.run.smithi017:> test -z $(ls -A /var/lib/ceph) 2024-04-17T02:10:34.230 DEBUG:teuthology.orchestra.run.smithi122:> test -z $(ls -A /var/lib/ceph) 2024-04-17T02:10:34.332 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-17T02:10:34.386 INFO:teuthology.run_tasks:Running task kernel... 2024-04-17T02:10:34.401 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-17T02:10:34.401 INFO:teuthology.task.kernel:config {'mgr.x': {'kdb': 1, 'sha1': 'distro'}, 'mgr.y': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-17T02:10:34.402 DEBUG:teuthology.orchestra.run.smithi017:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-17T02:10:34.402 DEBUG:teuthology.orchestra.run.smithi122:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-17T02:10:34.418 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T02:10:34.419 DEBUG:teuthology.orchestra.run.smithi122:> uname -r 2024-04-17T02:10:34.420 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T02:10:34.421 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2024-04-17T02:10:34.476 INFO:teuthology.orchestra.run.smithi122.stdout:5.14.0-361.el9.x86_64 2024-04-17T02:10:34.477 INFO:teuthology.task.kernel:Running kernel on smithi122: 5.14.0-361.el9.x86_64 2024-04-17T02:10:34.477 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum install -y kernel 2024-04-17T02:10:34.478 INFO:teuthology.orchestra.run.smithi017.stdout:5.14.0-361.el9.x86_64 2024-04-17T02:10:34.478 INFO:teuthology.task.kernel:Running kernel on smithi017: 5.14.0-361.el9.x86_64 2024-04-17T02:10:34.478 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum install -y kernel 2024-04-17T02:10:36.618 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-04-17T02:10:36.733 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS-9 - AppStream 12 MB/s | 6.7 MB 00:00 2024-04-17T02:10:38.075 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS-9 - BaseOS 7.0 MB/s | 2.0 MB 00:00 2024-04-17T02:10:38.167 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS-9 - BaseOS 5.9 MB/s | 2.0 MB 00:00 2024-04-17T02:10:38.857 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 8.0 MB 00:00 2024-04-17T02:10:47.282 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - BaseOS 939 kB/s | 8.0 MB 00:08 2024-04-17T02:10:52.878 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - AppStream 4.2 MB/s | 19 MB 00:04 2024-04-17T02:11:03.173 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - AppStream 841 kB/s | 19 MB 00:23 2024-04-17T02:11:05.825 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - CRB 669 kB/s | 6.2 MB 00:09 2024-04-17T02:11:07.300 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - Extras packages 50 kB/s | 16 kB 00:00 2024-04-17T02:11:09.105 INFO:teuthology.orchestra.run.smithi122.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-04-17T02:11:14.110 INFO:teuthology.orchestra.run.smithi122.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-04-17T02:11:16.406 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - CRB 667 kB/s | 6.2 MB 00:09 2024-04-17T02:11:17.132 INFO:teuthology.orchestra.run.smithi122.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-17T02:11:17.132 INFO:teuthology.orchestra.run.smithi122.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-17T02:11:17.133 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-04-17T02:11:17.133 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-17T02:11:17.133 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-04-17T02:11:17.133 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-17T02:11:17.133 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-04-17T02:11:17.133 INFO:teuthology.orchestra.run.smithi122.stdout: kernel x86_64 5.14.0-438.el9 CentOS-BaseOS 277 k 2024-04-17T02:11:17.133 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-04-17T02:11:17.133 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-core x86_64 5.14.0-438.el9 CentOS-BaseOS 15 M 2024-04-17T02:11:17.133 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-modules x86_64 5.14.0-438.el9 CentOS-BaseOS 34 M 2024-04-17T02:11:17.133 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-modules-core x86_64 5.14.0-438.el9 CentOS-BaseOS 28 M 2024-04-17T02:11:17.134 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:11:17.134 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-04-17T02:11:17.134 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-17T02:11:17.134 INFO:teuthology.orchestra.run.smithi122.stdout:Install 4 Packages 2024-04-17T02:11:17.134 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:11:17.134 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 77 M 2024-04-17T02:11:17.134 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 123 M 2024-04-17T02:11:17.134 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-04-17T02:11:17.134 INFO:teuthology.orchestra.run.smithi122.stdout:(1/4): kernel-5.14.0-438.el9.x86_64.rpm 943 kB/s | 277 kB 00:00 2024-04-17T02:11:17.630 INFO:teuthology.orchestra.run.smithi122.stdout:(2/4): kernel-core-5.14.0-438.el9.x86_64.rpm 15 MB/s | 15 MB 00:01 2024-04-17T02:11:18.048 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 16 kB 00:00 2024-04-17T02:11:18.421 INFO:teuthology.orchestra.run.smithi122.stdout:(3/4): kernel-modules-5.14.0-438.el9.x86_64.rpm 19 MB/s | 34 MB 00:01 2024-04-17T02:11:18.721 INFO:teuthology.orchestra.run.smithi122.stdout:(4/4): kernel-modules-core-5.14.0-438.el9.x86_6 15 MB/s | 28 MB 00:01 2024-04-17T02:11:18.725 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-04-17T02:11:18.725 INFO:teuthology.orchestra.run.smithi122.stdout:Total 36 MB/s | 77 MB 00:02 2024-04-17T02:11:18.725 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-04-17T02:11:19.107 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-04-17T02:11:19.107 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-04-17T02:11:19.508 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-04-17T02:11:19.955 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-04-17T02:11:19.955 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-04-17T02:11:22.266 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-04-17T02:11:22.857 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : kernel-modules-core-5.14.0-438.el9.x86_64 1/4 2024-04-17T02:11:22.949 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-17T02:11:24.833 INFO:teuthology.orchestra.run.smithi017.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-04-17T02:11:25.679 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-17T02:11:25.956 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-17T02:11:27.319 INFO:teuthology.orchestra.run.smithi017.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-17T02:11:27.319 INFO:teuthology.orchestra.run.smithi017.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-17T02:11:27.410 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-04-17T02:11:27.415 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-04-17T02:11:27.415 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-04-17T02:11:27.415 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-04-17T02:11:27.416 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-04-17T02:11:27.416 INFO:teuthology.orchestra.run.smithi017.stdout: kernel x86_64 5.14.0-438.el9 CentOS-BaseOS 277 k 2024-04-17T02:11:27.416 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-04-17T02:11:27.416 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-core x86_64 5.14.0-438.el9 CentOS-BaseOS 15 M 2024-04-17T02:11:27.416 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-modules x86_64 5.14.0-438.el9 CentOS-BaseOS 34 M 2024-04-17T02:11:27.416 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-modules-core x86_64 5.14.0-438.el9 CentOS-BaseOS 28 M 2024-04-17T02:11:27.416 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:11:27.416 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-04-17T02:11:27.416 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-04-17T02:11:27.416 INFO:teuthology.orchestra.run.smithi017.stdout:Install 4 Packages 2024-04-17T02:11:27.416 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:11:27.417 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 77 M 2024-04-17T02:11:27.417 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 123 M 2024-04-17T02:11:27.417 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-04-17T02:11:27.593 INFO:teuthology.orchestra.run.smithi017.stdout:(1/4): kernel-5.14.0-438.el9.x86_64.rpm 1.5 MB/s | 277 kB 00:00 2024-04-17T02:11:28.293 INFO:teuthology.orchestra.run.smithi017.stdout:(2/4): kernel-core-5.14.0-438.el9.x86_64.rpm 17 MB/s | 15 MB 00:00 2024-04-17T02:11:29.510 INFO:teuthology.orchestra.run.smithi017.stdout:(3/4): kernel-modules-core-5.14.0-438.el9.x86_6 14 MB/s | 28 MB 00:01 2024-04-17T02:11:29.810 INFO:teuthology.orchestra.run.smithi017.stdout:(4/4): kernel-modules-5.14.0-438.el9.x86_64.rpm 14 MB/s | 34 MB 00:02 2024-04-17T02:11:29.813 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-04-17T02:11:29.813 INFO:teuthology.orchestra.run.smithi017.stdout:Total 32 MB/s | 77 MB 00:02 2024-04-17T02:11:29.814 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-04-17T02:11:30.225 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-04-17T02:11:30.225 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-04-17T02:11:30.663 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-17T02:11:30.789 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : kernel-5.14.0-438.el9.x86_64 4/4 2024-04-17T02:11:31.115 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-04-17T02:11:31.115 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-04-17T02:11:33.549 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-04-17T02:11:34.171 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : kernel-modules-core-5.14.0-438.el9.x86_64 1/4 2024-04-17T02:11:34.251 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-17T02:11:35.506 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-17T02:11:37.103 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-17T02:11:37.238 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-17T02:11:42.302 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-17T02:11:42.345 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : kernel-5.14.0-438.el9.x86_64 4/4 2024-04-17T02:11:47.440 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-17T02:12:04.794 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 4/4 2024-04-17T02:12:04.795 INFO:teuthology.orchestra.run.smithi122.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-17T02:12:04.795 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:12:04.839 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 4/4 2024-04-17T02:12:05.187 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-5.14.0-438.el9.x86_64 4/4 2024-04-17T02:12:05.187 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : kernel-5.14.0-438.el9.x86_64 1/4 2024-04-17T02:12:05.187 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-17T02:12:05.187 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-17T02:12:05.621 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-17T02:12:05.621 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:12:05.621 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-04-17T02:12:05.621 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-5.14.0-438.el9.x86_64 2024-04-17T02:12:05.622 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-core-5.14.0-438.el9.x86_64 2024-04-17T02:12:05.622 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-modules-5.14.0-438.el9.x86_64 2024-04-17T02:12:05.622 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-modules-core-5.14.0-438.el9.x86_64 2024-04-17T02:12:05.622 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:12:05.622 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-04-17T02:12:05.957 DEBUG:teuthology.orchestra.run.smithi122:> rpm -q kernel | sort -rV | head -n 1 2024-04-17T02:12:06.058 INFO:teuthology.orchestra.run.smithi122.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-17T02:12:06.058 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-17T02:12:06.059 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-438.el9.x86_64 2024-04-17T02:12:06.059 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-17T02:12:06.059 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-17T02:12:06.059 INFO:teuthology.task.kernel:Installing distro kernel on mgr.y... 2024-04-17T02:12:06.059 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi122.front.sepia.ceph.com, path=None, version=distro) 2024-04-17T02:12:06.059 DEBUG:teuthology.orchestra.run.smithi122:> rpm -q kernel | sort -rV | head -n 1 2024-04-17T02:12:06.140 INFO:teuthology.orchestra.run.smithi122.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-17T02:12:06.140 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-17T02:12:06.140 DEBUG:teuthology.orchestra.run.smithi122:> sudo rpm -qi grub2-tools 2024-04-17T02:12:06.175 INFO:teuthology.orchestra.run.smithi122.stdout:Name : grub2-tools 2024-04-17T02:12:06.175 INFO:teuthology.orchestra.run.smithi122.stdout:Epoch : 1 2024-04-17T02:12:06.175 INFO:teuthology.orchestra.run.smithi122.stdout:Version : 2.06 2024-04-17T02:12:06.175 INFO:teuthology.orchestra.run.smithi122.stdout:Release : 68.el9 2024-04-17T02:12:06.175 INFO:teuthology.orchestra.run.smithi122.stdout:Architecture: x86_64 2024-04-17T02:12:06.175 INFO:teuthology.orchestra.run.smithi122.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-17T02:12:06.175 INFO:teuthology.orchestra.run.smithi122.stdout:Group : Unspecified 2024-04-17T02:12:06.175 INFO:teuthology.orchestra.run.smithi122.stdout:Size : 8264254 2024-04-17T02:12:06.175 INFO:teuthology.orchestra.run.smithi122.stdout:License : GPLv3+ 2024-04-17T02:12:06.175 INFO:teuthology.orchestra.run.smithi122.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-17T02:12:06.175 INFO:teuthology.orchestra.run.smithi122.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-17T02:12:06.176 INFO:teuthology.orchestra.run.smithi122.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-17T02:12:06.176 INFO:teuthology.orchestra.run.smithi122.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-17T02:12:06.176 INFO:teuthology.orchestra.run.smithi122.stdout:Packager : builder@centos.org 2024-04-17T02:12:06.176 INFO:teuthology.orchestra.run.smithi122.stdout:Vendor : CentOS 2024-04-17T02:12:06.176 INFO:teuthology.orchestra.run.smithi122.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-17T02:12:06.176 INFO:teuthology.orchestra.run.smithi122.stdout:Summary : Support tools for GRUB. 2024-04-17T02:12:06.176 INFO:teuthology.orchestra.run.smithi122.stdout:Description : 2024-04-17T02:12:06.176 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:12:06.176 INFO:teuthology.orchestra.run.smithi122.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-17T02:12:06.176 INFO:teuthology.orchestra.run.smithi122.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-17T02:12:06.176 INFO:teuthology.orchestra.run.smithi122.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-17T02:12:06.176 INFO:teuthology.orchestra.run.smithi122.stdout:hardware devices. 2024-04-17T02:12:06.176 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:12:06.176 INFO:teuthology.orchestra.run.smithi122.stdout:This subpackage provides tools for support of all platforms. 2024-04-17T02:12:06.177 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-17T02:12:06.177 INFO:teuthology.task.kernel:Updating grub on smithi122 to boot 5.14.0-438.el9.x86_64 2024-04-17T02:12:06.177 DEBUG:teuthology.orchestra.run.smithi122:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-17T02:12:06.743 INFO:teuthology.orchestra.run.smithi122.stderr:Generating grub configuration file ... 2024-04-17T02:12:08.093 INFO:teuthology.orchestra.run.smithi122.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-17T02:12:08.123 INFO:teuthology.orchestra.run.smithi122.stderr:done 2024-04-17T02:12:08.125 DEBUG:teuthology.orchestra.run.smithi122:> mktemp 2024-04-17T02:12:08.140 INFO:teuthology.orchestra.run.smithi122.stdout:/tmp/tmp.ZPf1Ar9JyL 2024-04-17T02:12:08.140 DEBUG:teuthology.orchestra.run.smithi122:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ZPf1Ar9JyL 2024-04-17T02:12:08.209 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 0666 /tmp/tmp.ZPf1Ar9JyL 2024-04-17T02:12:08.354 DEBUG:teuthology.orchestra.remote:smithi122:/tmp/tmp.ZPf1Ar9JyL is 6KB 2024-04-17T02:12:08.402 DEBUG:teuthology.orchestra.run.smithi122:> rm -fr /tmp/tmp.ZPf1Ar9JyL 2024-04-17T02:12:08.416 DEBUG:teuthology.orchestra.run.smithi122:> sudo /bin/ls /boot/loader/entries || true 2024-04-17T02:12:08.481 INFO:teuthology.orchestra.run.smithi122.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-17T02:12:08.481 INFO:teuthology.orchestra.run.smithi122.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-17T02:12:08.481 INFO:teuthology.orchestra.run.smithi122.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-17T02:12:08.481 INFO:teuthology.orchestra.run.smithi122.stdout:15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64.conf 2024-04-17T02:12:08.482 DEBUG:teuthology.orchestra.run.smithi122:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64 2024-04-17T02:12:08.626 DEBUG:teuthology.orchestra.run.smithi122:> sudo shutdown -r now 2024-04-17T02:12:18.376 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 4/4 2024-04-17T02:12:18.376 INFO:teuthology.orchestra.run.smithi017.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-17T02:12:18.376 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:12:18.421 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 4/4 2024-04-17T02:12:18.819 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-5.14.0-438.el9.x86_64 4/4 2024-04-17T02:12:18.819 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : kernel-5.14.0-438.el9.x86_64 1/4 2024-04-17T02:12:18.819 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-17T02:12:18.819 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-17T02:12:19.252 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-17T02:12:19.252 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:12:19.253 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-04-17T02:12:19.253 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-5.14.0-438.el9.x86_64 2024-04-17T02:12:19.253 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-core-5.14.0-438.el9.x86_64 2024-04-17T02:12:19.253 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-modules-5.14.0-438.el9.x86_64 2024-04-17T02:12:19.253 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-modules-core-5.14.0-438.el9.x86_64 2024-04-17T02:12:19.253 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:12:19.253 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-04-17T02:12:19.562 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q kernel | sort -rV | head -n 1 2024-04-17T02:12:19.664 INFO:teuthology.orchestra.run.smithi017.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-17T02:12:19.665 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-17T02:12:19.665 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-438.el9.x86_64 2024-04-17T02:12:19.665 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-17T02:12:19.665 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-17T02:12:19.665 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-04-17T02:12:19.665 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi017.front.sepia.ceph.com, path=None, version=distro) 2024-04-17T02:12:19.665 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q kernel | sort -rV | head -n 1 2024-04-17T02:12:19.748 INFO:teuthology.orchestra.run.smithi017.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-17T02:12:19.749 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-17T02:12:19.749 DEBUG:teuthology.orchestra.run.smithi017:> sudo rpm -qi grub2-tools 2024-04-17T02:12:19.786 INFO:teuthology.orchestra.run.smithi017.stdout:Name : grub2-tools 2024-04-17T02:12:19.786 INFO:teuthology.orchestra.run.smithi017.stdout:Epoch : 1 2024-04-17T02:12:19.786 INFO:teuthology.orchestra.run.smithi017.stdout:Version : 2.06 2024-04-17T02:12:19.786 INFO:teuthology.orchestra.run.smithi017.stdout:Release : 68.el9 2024-04-17T02:12:19.786 INFO:teuthology.orchestra.run.smithi017.stdout:Architecture: x86_64 2024-04-17T02:12:19.787 INFO:teuthology.orchestra.run.smithi017.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-17T02:12:19.787 INFO:teuthology.orchestra.run.smithi017.stdout:Group : Unspecified 2024-04-17T02:12:19.787 INFO:teuthology.orchestra.run.smithi017.stdout:Size : 8264254 2024-04-17T02:12:19.787 INFO:teuthology.orchestra.run.smithi017.stdout:License : GPLv3+ 2024-04-17T02:12:19.787 INFO:teuthology.orchestra.run.smithi017.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-17T02:12:19.787 INFO:teuthology.orchestra.run.smithi017.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-17T02:12:19.787 INFO:teuthology.orchestra.run.smithi017.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-17T02:12:19.787 INFO:teuthology.orchestra.run.smithi017.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-17T02:12:19.787 INFO:teuthology.orchestra.run.smithi017.stdout:Packager : builder@centos.org 2024-04-17T02:12:19.787 INFO:teuthology.orchestra.run.smithi017.stdout:Vendor : CentOS 2024-04-17T02:12:19.787 INFO:teuthology.orchestra.run.smithi017.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-17T02:12:19.787 INFO:teuthology.orchestra.run.smithi017.stdout:Summary : Support tools for GRUB. 2024-04-17T02:12:19.787 INFO:teuthology.orchestra.run.smithi017.stdout:Description : 2024-04-17T02:12:19.788 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:12:19.788 INFO:teuthology.orchestra.run.smithi017.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-17T02:12:19.788 INFO:teuthology.orchestra.run.smithi017.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-17T02:12:19.788 INFO:teuthology.orchestra.run.smithi017.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-17T02:12:19.788 INFO:teuthology.orchestra.run.smithi017.stdout:hardware devices. 2024-04-17T02:12:19.788 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:12:19.788 INFO:teuthology.orchestra.run.smithi017.stdout:This subpackage provides tools for support of all platforms. 2024-04-17T02:12:19.789 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-17T02:12:19.789 INFO:teuthology.task.kernel:Updating grub on smithi017 to boot 5.14.0-438.el9.x86_64 2024-04-17T02:12:19.789 DEBUG:teuthology.orchestra.run.smithi017:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-17T02:12:20.417 INFO:teuthology.orchestra.run.smithi017.stderr:Generating grub configuration file ... 2024-04-17T02:12:21.855 INFO:teuthology.orchestra.run.smithi017.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-17T02:12:21.882 INFO:teuthology.orchestra.run.smithi017.stderr:done 2024-04-17T02:12:21.892 DEBUG:teuthology.orchestra.run.smithi017:> mktemp 2024-04-17T02:12:21.909 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.lJZvVasSWh 2024-04-17T02:12:21.910 DEBUG:teuthology.orchestra.run.smithi017:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.lJZvVasSWh 2024-04-17T02:12:21.991 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.lJZvVasSWh 2024-04-17T02:12:22.135 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.lJZvVasSWh is 6KB 2024-04-17T02:12:22.184 DEBUG:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.lJZvVasSWh 2024-04-17T02:12:22.199 DEBUG:teuthology.orchestra.run.smithi017:> sudo /bin/ls /boot/loader/entries || true 2024-04-17T02:12:22.267 INFO:teuthology.orchestra.run.smithi017.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-17T02:12:22.267 INFO:teuthology.orchestra.run.smithi017.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-17T02:12:22.268 INFO:teuthology.orchestra.run.smithi017.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-17T02:12:22.268 INFO:teuthology.orchestra.run.smithi017.stdout:15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64.conf 2024-04-17T02:12:22.269 DEBUG:teuthology.orchestra.run.smithi017:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64 2024-04-17T02:12:22.426 DEBUG:teuthology.orchestra.run.smithi017:> sudo shutdown -r now 2024-04-17T02:12:38.642 INFO:teuthology.task.kernel:Checking client mgr.y for new kernel version... 2024-04-17T02:12:38.643 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-04-17T02:12:38.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T02:12:52.442 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-04-17T02:12:52.443 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-04-17T02:12:52.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T02:12:56.994 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-04-17T02:13:06.002 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-04-17T02:13:06.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T02:13:09.054 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-04-17T02:13:10.818 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.17 2024-04-17T02:13:19.826 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-04-17T02:13:19.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T02:13:21.056 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-04-17T02:13:21.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T02:13:52.898 DEBUG:teuthology.orchestra.run.smithi122:> true 2024-04-17T02:13:53.318 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-04-17T02:13:53.318 INFO:teuthology.task.kernel:Checking kernel version of mgr.y, want "5.14.0-438.el9.x86_64"... 2024-04-17T02:13:53.319 DEBUG:teuthology.orchestra.run.smithi122:> uname -r 2024-04-17T02:13:53.333 INFO:teuthology.orchestra.run.smithi122.stdout:5.14.0-438.el9.x86_64 2024-04-17T02:13:53.334 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-438.el9.x86_64 vs 5.14.0-438.el9.x86_64 2024-04-17T02:13:53.334 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-17T02:13:53.334 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-17T02:13:54.334 INFO:teuthology.task.kernel:Enabling kdb on mgr.y... 2024-04-17T02:13:54.335 DEBUG:teuthology.orchestra.run.smithi122:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-17T02:13:54.420 INFO:teuthology.orchestra.run.smithi122.stdout:ttyS1 2024-04-17T02:13:54.457 DEBUG:teuthology.parallel:result is None 2024-04-17T02:14:19.830 DEBUG:teuthology.orchestra.remote:timed out 2024-04-17T02:14:31.831 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-04-17T02:14:31.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T02:14:32.210 DEBUG:teuthology.orchestra.run.smithi017:> true 2024-04-17T02:14:32.608 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-04-17T02:14:32.608 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-438.el9.x86_64"... 2024-04-17T02:14:32.608 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2024-04-17T02:14:32.624 INFO:teuthology.orchestra.run.smithi017.stdout:5.14.0-438.el9.x86_64 2024-04-17T02:14:32.624 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-438.el9.x86_64 vs 5.14.0-438.el9.x86_64 2024-04-17T02:14:32.624 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-17T02:14:32.624 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-17T02:14:33.625 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-04-17T02:14:33.625 DEBUG:teuthology.orchestra.run.smithi017:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-17T02:14:33.708 INFO:teuthology.orchestra.run.smithi017.stdout:ttyS1 2024-04-17T02:14:33.737 DEBUG:teuthology.parallel:result is None 2024-04-17T02:14:33.738 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-17T02:14:33.745 INFO:teuthology.task.internal:Creating test directory... 2024-04-17T02:14:33.745 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-17T02:14:33.747 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-17T02:14:33.767 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-17T02:14:33.773 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-17T02:14:33.784 INFO:teuthology.task.internal:Creating archive directory... 2024-04-17T02:14:33.784 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-17T02:14:33.805 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-17T02:14:33.914 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-17T02:14:33.921 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-17T02:14:33.921 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-17T02:14:33.923 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-17T02:14:33.964 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-17T02:14:33.964 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-17T02:14:33.978 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-17T02:14:33.978 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-17T02:14:33.981 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-17T02:14:33.988 INFO:teuthology.task.internal:Configuring sudo... 2024-04-17T02:14:33.988 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-17T02:14:34.023 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-17T02:14:34.054 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-17T02:14:34.063 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-17T02:14:34.063 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-17T02:14:34.094 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-17T02:14:34.111 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-17T02:14:34.193 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-17T02:14:34.237 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-17T02:14:34.322 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-17T02:14:34.365 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-04-17T02:14:34.365 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-17T02:14:34.433 DEBUG:teuthology.orchestra.run.smithi122:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-17T02:14:34.477 DEBUG:teuthology.orchestra.run.smithi122:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-17T02:14:34.529 DEBUG:teuthology.orchestra.run.smithi122:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-17T02:14:34.613 DEBUG:teuthology.orchestra.run.smithi122:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-17T02:14:34.657 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-17T02:14:34.658 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-17T02:14:34.728 DEBUG:teuthology.orchestra.run.smithi017:> sudo service rsyslog restart 2024-04-17T02:14:34.731 DEBUG:teuthology.orchestra.run.smithi122:> sudo service rsyslog restart 2024-04-17T02:14:34.778 INFO:teuthology.orchestra.run.smithi017.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-17T02:14:34.823 INFO:teuthology.orchestra.run.smithi122.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-17T02:14:35.303 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-17T02:14:35.311 INFO:teuthology.task.internal:Starting timer... 2024-04-17T02:14:35.311 INFO:teuthology.run_tasks:Running task pcp... 2024-04-17T02:14:35.322 INFO:teuthology.run_tasks:Running task selinux... 2024-04-17T02:14:35.330 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-17T02:14:35.331 DEBUG:teuthology.orchestra.run.smithi017:> sudo service auditd rotate 2024-04-17T02:14:35.386 INFO:teuthology.orchestra.run.smithi017.stdout:Rotating logs: 2024-04-17T02:14:35.387 DEBUG:teuthology.orchestra.run.smithi122:> sudo service auditd rotate 2024-04-17T02:14:35.468 INFO:teuthology.orchestra.run.smithi122.stdout:Rotating logs: 2024-04-17T02:14:35.470 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-17T02:14:35.470 DEBUG:teuthology.orchestra.run.smithi017:> /usr/sbin/getenforce 2024-04-17T02:14:35.496 INFO:teuthology.orchestra.run.smithi017.stdout:Permissive 2024-04-17T02:14:35.496 DEBUG:teuthology.orchestra.run.smithi122:> /usr/sbin/getenforce 2024-04-17T02:14:35.520 INFO:teuthology.orchestra.run.smithi122.stdout:Permissive 2024-04-17T02:14:35.521 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi017.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi122.front.sepia.ceph.com': 'permissive'} 2024-04-17T02:14:35.521 DEBUG:teuthology.orchestra.run.smithi017:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-17T02:14:35.565 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T02:14:35.566 DEBUG:teuthology.orchestra.run.smithi122:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-17T02:14:35.596 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T02:14:35.597 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-17T02:14:35.597 DEBUG:teuthology.orchestra.run.smithi017:> sudo /usr/sbin/setenforce permissive 2024-04-17T02:14:35.639 DEBUG:teuthology.orchestra.run.smithi122:> sudo /usr/sbin/setenforce permissive 2024-04-17T02:14:35.672 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-17T02:14:35.682 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-17T02:14:35.700 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-17T02:14:35.701 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi017.front.sepia.ceph.com,smithi122.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-17T02:18:55.204 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi017.front.sepia.ceph.com'), Remote(name='ubuntu@smithi122.front.sepia.ceph.com')] 2024-04-17T02:18:55.206 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-04-17T02:18:55.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T02:18:55.298 DEBUG:teuthology.orchestra.run.smithi017:> true 2024-04-17T02:18:55.378 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-04-17T02:18:55.378 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-04-17T02:18:55.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T02:18:55.467 DEBUG:teuthology.orchestra.run.smithi122:> true 2024-04-17T02:18:55.541 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-04-17T02:18:55.542 INFO:teuthology.run_tasks:Running task clock... 2024-04-17T02:18:55.553 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-17T02:18:55.553 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-17T02:18:55.554 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-17T02:18:55.556 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-17T02:18:55.556 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-17T02:18:55.588 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-17T02:18:55.606 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-17T02:18:55.615 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-17T02:18:55.633 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-17T02:18:55.638 INFO:teuthology.orchestra.run.smithi017.stderr:sudo: ntpd: command not found 2024-04-17T02:18:55.652 INFO:teuthology.orchestra.run.smithi017.stdout:506 Cannot talk to daemon 2024-04-17T02:18:55.664 INFO:teuthology.orchestra.run.smithi122.stderr:sudo: ntpd: command not found 2024-04-17T02:18:55.670 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-17T02:18:55.677 INFO:teuthology.orchestra.run.smithi122.stdout:506 Cannot talk to daemon 2024-04-17T02:18:55.687 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-17T02:18:55.694 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-17T02:18:55.712 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-17T02:18:55.738 INFO:teuthology.orchestra.run.smithi017.stderr:bash: line 1: ntpq: command not found 2024-04-17T02:18:55.742 INFO:teuthology.orchestra.run.smithi017.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-17T02:18:55.742 INFO:teuthology.orchestra.run.smithi017.stdout:=============================================================================== 2024-04-17T02:18:55.742 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-17T02:18:55.742 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-17T02:18:55.742 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-17T02:18:55.742 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-17T02:18:55.771 INFO:teuthology.orchestra.run.smithi122.stderr:bash: line 1: ntpq: command not found 2024-04-17T02:18:55.774 INFO:teuthology.orchestra.run.smithi122.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-17T02:18:55.774 INFO:teuthology.orchestra.run.smithi122.stdout:=============================================================================== 2024-04-17T02:18:55.774 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-17T02:18:55.774 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-17T02:18:55.774 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-17T02:18:55.774 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-17T02:18:55.775 INFO:teuthology.run_tasks:Running task install... 2024-04-17T02:18:55.783 DEBUG:teuthology.task.install:project ceph 2024-04-17T02:18:55.784 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '687eba7a6534970dd256b49bc87e74b01871539e'}} 2024-04-17T02:18:55.784 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '687eba7a6534970dd256b49bc87e74b01871539e'} 2024-04-17T02:18:55.784 INFO:teuthology.task.install:Using flavor: default 2024-04-17T02:18:55.790 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-17T02:18:55.790 INFO:teuthology.task.install:extra packages: [] 2024-04-17T02:18:55.791 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '687eba7a6534970dd256b49bc87e74b01871539e', 'tag': None, 'wait_for_package': False} 2024-04-17T02:18:55.791 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=687eba7a6534970dd256b49bc87e74b01871539e 2024-04-17T02:18:55.793 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '687eba7a6534970dd256b49bc87e74b01871539e', 'tag': None, 'wait_for_package': False} 2024-04-17T02:18:55.794 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=687eba7a6534970dd256b49bc87e74b01871539e 2024-04-17T02:18:55.942 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240416.150233/687eba7a6534970dd256b49bc87e74b01871539e/centos/9/flavors/default/ 2024-04-17T02:18:55.942 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2311.g687eba7a 2024-04-17T02:18:56.014 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240416.150233/687eba7a6534970dd256b49bc87e74b01871539e/centos/9/flavors/default/ 2024-04-17T02:18:56.014 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2311.g687eba7a 2024-04-17T02:18:56.119 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240416.150233/687eba7a6534970dd256b49bc87e74b01871539e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240416.150233/687eba7a6534970dd256b49bc87e74b01871539e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240416.150233/687eba7a6534970dd256b49bc87e74b01871539e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-17T02:18:56.120 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-04-17T02:18:56.120 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-17T02:18:56.149 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-17T02:18:56.149 DEBUG:teuthology.orchestra.run.smithi017:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/687eba7a6534970dd256b49bc87e74b01871539e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-17T02:18:56.219 DEBUG:teuthology.orchestra.run.smithi017:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-17T02:18:56.302 DEBUG:teuthology.orchestra.run.smithi017:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-17T02:18:56.351 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240416.150233/687eba7a6534970dd256b49bc87e74b01871539e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240416.150233/687eba7a6534970dd256b49bc87e74b01871539e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240416.150233/687eba7a6534970dd256b49bc87e74b01871539e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-17T02:18:56.351 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-17T02:18:56.351 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-17T02:18:56.370 INFO:teuthology.orchestra.run.smithi017.stdout:check_obsoletes = 1 2024-04-17T02:18:56.371 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum clean all 2024-04-17T02:18:56.384 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-17T02:18:56.384 DEBUG:teuthology.orchestra.run.smithi122:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/687eba7a6534970dd256b49bc87e74b01871539e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-17T02:18:56.457 DEBUG:teuthology.orchestra.run.smithi122:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-17T02:18:56.545 DEBUG:teuthology.orchestra.run.smithi122:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-17T02:18:56.574 INFO:teuthology.orchestra.run.smithi122.stdout:check_obsoletes = 1 2024-04-17T02:18:56.578 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum clean all 2024-04-17T02:18:56.621 INFO:teuthology.orchestra.run.smithi017.stdout:74 files removed 2024-04-17T02:18:56.648 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-radosgw 2024-04-17T02:18:56.828 INFO:teuthology.orchestra.run.smithi122.stdout:74 files removed 2024-04-17T02:18:56.855 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-radosgw 2024-04-17T02:18:57.429 INFO:teuthology.orchestra.run.smithi017.stdout:ceph packages for x86_64 176 kB/s | 83 kB 00:00 2024-04-17T02:18:57.676 INFO:teuthology.orchestra.run.smithi122.stdout:ceph packages for x86_64 161 kB/s | 83 kB 00:00 2024-04-17T02:18:58.288 INFO:teuthology.orchestra.run.smithi017.stdout:ceph noarch packages 14 kB/s | 11 kB 00:00 2024-04-17T02:18:58.318 INFO:teuthology.orchestra.run.smithi122.stdout:ceph noarch packages 19 kB/s | 11 kB 00:00 2024-04-17T02:18:58.677 INFO:teuthology.orchestra.run.smithi122.stdout:ceph source packages 6.0 kB/s | 1.9 kB 00:00 2024-04-17T02:18:58.989 INFO:teuthology.orchestra.run.smithi017.stdout:ceph source packages 2.9 kB/s | 1.9 kB 00:00 2024-04-17T02:18:59.263 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS-9 - AppStream 12 MB/s | 6.7 MB 00:00 2024-04-17T02:18:59.474 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS-9 - AppStream 15 MB/s | 6.7 MB 00:00 2024-04-17T02:19:00.638 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS-9 - BaseOS 7.5 MB/s | 2.0 MB 00:00 2024-04-17T02:19:00.900 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS-9 - BaseOS 7.2 MB/s | 2.0 MB 00:00 2024-04-17T02:19:01.815 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-04-17T02:19:02.428 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - BaseOS 5.5 MB/s | 8.0 MB 00:01 2024-04-17T02:19:03.626 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - AppStream 28 MB/s | 19 MB 00:00 2024-04-17T02:19:07.146 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - AppStream 5.3 MB/s | 19 MB 00:03 2024-04-17T02:19:07.792 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-04-17T02:19:09.502 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 16 kB 00:00 2024-04-17T02:19:15.039 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 3.9 MB/s | 21 MB 00:05 2024-04-17T02:19:19.738 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - CRB 699 kB/s | 6.2 MB 00:09 2024-04-17T02:19:20.269 INFO:teuthology.orchestra.run.smithi017.stdout:lab-extras 51 kB/s | 1.7 kB 00:00 2024-04-17T02:19:21.355 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - Extras packages 76 kB/s | 16 kB 00:00 2024-04-17T02:19:23.135 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-04-17T02:19:23.149 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-04-17T02:19:23.149 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-04-17T02:19:23.149 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-04-17T02:19:23.149 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-04-17T02:19:23.149 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 10 M 2024-04-17T02:19:23.150 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrading: 2024-04-17T02:19:23.150 INFO:teuthology.orchestra.run.smithi017.stdout: librados2 x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 3.4 M 2024-04-17T02:19:23.150 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1 x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 3.1 M 2024-04-17T02:19:23.150 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-04-17T02:19:23.150 INFO:teuthology.orchestra.run.smithi017.stdout: boost-program-options 2024-04-17T02:19:23.150 INFO:teuthology.orchestra.run.smithi017.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-04-17T02:19:23.150 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 5.4 M 2024-04-17T02:19:23.150 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 21 M 2024-04-17T02:19:23.150 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 25 k 2024-04-17T02:19:23.150 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-17T02:19:23.150 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-17T02:19:23.150 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-17T02:19:23.150 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2 x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 745 k 2024-04-17T02:19:23.151 INFO:teuthology.orchestra.run.smithi017.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-17T02:19:23.151 INFO:teuthology.orchestra.run.smithi017.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-17T02:19:23.151 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-17T02:19:23.151 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1 x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 501 k 2024-04-17T02:19:23.151 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-17T02:19:23.151 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2 x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 5.3 M 2024-04-17T02:19:23.151 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-17T02:19:23.151 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-17T02:19:23.151 INFO:teuthology.orchestra.run.smithi017.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-17T02:19:23.151 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse 2024-04-17T02:19:23.151 INFO:teuthology.orchestra.run.smithi017.stdout: x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 45 k 2024-04-17T02:19:23.151 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 131 k 2024-04-17T02:19:23.151 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 162 k 2024-04-17T02:19:23.151 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-17T02:19:23.152 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 320 k 2024-04-17T02:19:23.152 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 299 k 2024-04-17T02:19:23.152 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 100 k 2024-04-17T02:19:23.152 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-04-17T02:19:23.152 INFO:teuthology.orchestra.run.smithi017.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-04-17T02:19:23.152 INFO:teuthology.orchestra.run.smithi017.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-17T02:19:23.152 INFO:teuthology.orchestra.run.smithi017.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-17T02:19:23.152 INFO:teuthology.orchestra.run.smithi017.stdout:Installing weak dependencies: 2024-04-17T02:19:23.152 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-04-17T02:19:23.152 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:19:23.152 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-04-17T02:19:23.152 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-04-17T02:19:23.152 INFO:teuthology.orchestra.run.smithi017.stdout:Install 30 Packages 2024-04-17T02:19:23.152 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrade 2 Packages 2024-04-17T02:19:23.153 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:19:23.153 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 60 M 2024-04-17T02:19:23.153 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-04-17T02:19:23.623 INFO:teuthology.orchestra.run.smithi122.stdout:Extra Packages for Enterprise Linux 9.8 MB/s | 21 MB 00:02 2024-04-17T02:19:24.779 INFO:teuthology.orchestra.run.smithi017.stdout:(1/32): ceph-radosgw-19.0.0-2311.g687eba7a.el9. 8.1 MB/s | 10 MB 00:01 2024-04-17T02:19:24.845 INFO:teuthology.orchestra.run.smithi017.stdout:(2/32): ceph-base-19.0.0-2311.g687eba7a.el9.x86 4.0 MB/s | 5.4 MB 00:01 2024-04-17T02:19:24.862 INFO:teuthology.orchestra.run.smithi017.stdout:(3/32): ceph-selinux-19.0.0-2311.g687eba7a.el9. 301 kB/s | 25 kB 00:00 2024-04-17T02:19:25.354 INFO:teuthology.orchestra.run.smithi017.stdout:(4/32): ceph-common-19.0.0-2311.g687eba7a.el9.x 11 MB/s | 21 MB 00:01 2024-04-17T02:19:25.379 INFO:teuthology.orchestra.run.smithi017.stdout:(5/32): libradosstriper1-19.0.0-2311.g687eba7a. 970 kB/s | 501 kB 00:00 2024-04-17T02:19:25.413 INFO:teuthology.orchestra.run.smithi017.stdout:(6/32): libcephfs2-19.0.0-2311.g687eba7a.el9.x8 1.3 MB/s | 745 kB 00:00 2024-04-17T02:19:25.447 INFO:teuthology.orchestra.run.smithi017.stdout:(7/32): python3-ceph-argparse-19.0.0-2311.g687e 675 kB/s | 45 kB 00:00 2024-04-17T02:19:25.489 INFO:teuthology.orchestra.run.smithi017.stdout:(8/32): python3-ceph-common-19.0.0-2311.g687eba 1.7 MB/s | 131 kB 00:00 2024-04-17T02:19:25.530 INFO:teuthology.orchestra.run.smithi017.stdout:(9/32): python3-cephfs-19.0.0-2311.g687eba7a.el 1.9 MB/s | 162 kB 00:00 2024-04-17T02:19:25.581 INFO:teuthology.orchestra.run.smithi017.stdout:(10/32): python3-rados-19.0.0-2311.g687eba7a.el 3.4 MB/s | 320 kB 00:00 2024-04-17T02:19:25.606 INFO:teuthology.orchestra.run.smithi017.stdout:(11/32): python3-rbd-19.0.0-2311.g687eba7a.el9. 3.9 MB/s | 299 kB 00:00 2024-04-17T02:19:25.631 INFO:teuthology.orchestra.run.smithi017.stdout:(12/32): python3-rgw-19.0.0-2311.g687eba7a.el9. 1.9 MB/s | 100 kB 00:00 2024-04-17T02:19:25.740 INFO:teuthology.orchestra.run.smithi017.stdout:(13/32): librgw2-19.0.0-2311.g687eba7a.el9.x86_ 14 MB/s | 5.3 MB 00:00 2024-04-17T02:19:25.807 INFO:teuthology.orchestra.run.smithi017.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 528 kB/s | 106 kB 00:00 2024-04-17T02:19:25.832 INFO:teuthology.orchestra.run.smithi017.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 692 kB/s | 44 kB 00:00 2024-04-17T02:19:25.866 INFO:teuthology.orchestra.run.smithi017.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 770 kB/s | 159 kB 00:00 2024-04-17T02:19:25.891 INFO:teuthology.orchestra.run.smithi017.stdout:(17/32): librdkafka-1.6.1-102.el9.x86_64.rpm 7.8 MB/s | 661 kB 00:00 2024-04-17T02:19:25.916 INFO:teuthology.orchestra.run.smithi017.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.3 MB/s | 282 kB 00:00 2024-04-17T02:19:25.941 INFO:teuthology.orchestra.run.smithi017.stdout:(19/32): python3-prettytable-0.7.2-27.el9.noarc 552 kB/s | 41 kB 00:00 2024-04-17T02:19:25.958 INFO:teuthology.orchestra.run.smithi017.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 838 kB/s | 35 kB 00:00 2024-04-17T02:19:25.983 INFO:teuthology.orchestra.run.smithi017.stdout:(21/32): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 220 kB 00:00 2024-04-17T02:19:26.000 INFO:teuthology.orchestra.run.smithi017.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 792 kB/s | 46 kB 00:00 2024-04-17T02:19:26.301 INFO:teuthology.orchestra.run.smithi017.stdout:(23/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 87 kB/s | 26 kB 00:00 2024-04-17T02:19:26.560 INFO:teuthology.orchestra.run.smithi017.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 188 kB/s | 49 kB 00:00 2024-04-17T02:19:26.918 INFO:teuthology.orchestra.run.smithi017.stdout:(25/32): libunwind-1.6.2-1.el9.x86_64.rpm 188 kB/s | 67 kB 00:00 2024-04-17T02:19:27.301 INFO:teuthology.orchestra.run.smithi017.stdout:(26/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 230 kB/s | 309 kB 00:01 2024-04-17T02:19:27.868 INFO:teuthology.orchestra.run.smithi017.stdout:(27/32): re2-20211101-3.el9.x86_64.rpm 338 kB/s | 192 kB 00:00 2024-04-17T02:19:28.690 INFO:teuthology.orchestra.run.smithi122.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-04-17T02:19:29.110 INFO:teuthology.orchestra.run.smithi017.stdout:(28/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 382 kB/s | 838 kB 00:02 2024-04-17T02:19:29.435 INFO:teuthology.orchestra.run.smithi017.stdout:(29/32): librados2-19.0.0-2311.g687eba7a.el9.x8 10 MB/s | 3.4 MB 00:00 2024-04-17T02:19:29.628 INFO:teuthology.orchestra.run.smithi017.stdout:(30/32): librbd1-19.0.0-2311.g687eba7a.el9.x86_ 16 MB/s | 3.1 MB 00:00 2024-04-17T02:19:31.194 INFO:teuthology.orchestra.run.smithi017.stdout:(31/32): thrift-0.15.0-2.el9.x86_64.rpm 487 kB/s | 1.6 MB 00:03 2024-04-17T02:19:31.452 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-04-17T02:19:31.466 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-17T02:19:31.467 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-04-17T02:19:31.467 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-17T02:19:31.467 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-04-17T02:19:31.467 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-radosgw x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 10 M 2024-04-17T02:19:31.467 INFO:teuthology.orchestra.run.smithi122.stdout:Upgrading: 2024-04-17T02:19:31.467 INFO:teuthology.orchestra.run.smithi122.stdout: librados2 x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 3.4 M 2024-04-17T02:19:31.467 INFO:teuthology.orchestra.run.smithi122.stdout: librbd1 x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 3.1 M 2024-04-17T02:19:31.467 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-04-17T02:19:31.467 INFO:teuthology.orchestra.run.smithi122.stdout: boost-program-options 2024-04-17T02:19:31.467 INFO:teuthology.orchestra.run.smithi122.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-04-17T02:19:31.467 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-base x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 5.4 M 2024-04-17T02:19:31.467 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-common x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 21 M 2024-04-17T02:19:31.467 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-selinux x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 25 k 2024-04-17T02:19:31.468 INFO:teuthology.orchestra.run.smithi122.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-17T02:19:31.468 INFO:teuthology.orchestra.run.smithi122.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-17T02:19:31.468 INFO:teuthology.orchestra.run.smithi122.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-17T02:19:31.468 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs2 x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 745 k 2024-04-17T02:19:31.468 INFO:teuthology.orchestra.run.smithi122.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-17T02:19:31.468 INFO:teuthology.orchestra.run.smithi122.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-17T02:19:31.468 INFO:teuthology.orchestra.run.smithi122.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-17T02:19:31.468 INFO:teuthology.orchestra.run.smithi122.stdout: libradosstriper1 x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 501 k 2024-04-17T02:19:31.468 INFO:teuthology.orchestra.run.smithi122.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-17T02:19:31.468 INFO:teuthology.orchestra.run.smithi122.stdout: librgw2 x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 5.3 M 2024-04-17T02:19:31.468 INFO:teuthology.orchestra.run.smithi122.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-17T02:19:31.468 INFO:teuthology.orchestra.run.smithi122.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-17T02:19:31.468 INFO:teuthology.orchestra.run.smithi122.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-17T02:19:31.468 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-argparse 2024-04-17T02:19:31.468 INFO:teuthology.orchestra.run.smithi122.stdout: x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 45 k 2024-04-17T02:19:31.469 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-common x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 131 k 2024-04-17T02:19:31.469 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cephfs x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 162 k 2024-04-17T02:19:31.469 INFO:teuthology.orchestra.run.smithi122.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-17T02:19:31.469 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rados x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 320 k 2024-04-17T02:19:31.469 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rbd x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 299 k 2024-04-17T02:19:31.469 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rgw x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 100 k 2024-04-17T02:19:31.469 INFO:teuthology.orchestra.run.smithi122.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-04-17T02:19:31.469 INFO:teuthology.orchestra.run.smithi122.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-04-17T02:19:31.469 INFO:teuthology.orchestra.run.smithi122.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-17T02:19:31.469 INFO:teuthology.orchestra.run.smithi122.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-17T02:19:31.469 INFO:teuthology.orchestra.run.smithi122.stdout:Installing weak dependencies: 2024-04-17T02:19:31.469 INFO:teuthology.orchestra.run.smithi122.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-04-17T02:19:31.469 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:19:31.469 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-04-17T02:19:31.469 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-17T02:19:31.470 INFO:teuthology.orchestra.run.smithi122.stdout:Install 30 Packages 2024-04-17T02:19:31.470 INFO:teuthology.orchestra.run.smithi122.stdout:Upgrade 2 Packages 2024-04-17T02:19:31.470 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:19:31.470 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 60 M 2024-04-17T02:19:31.470 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-04-17T02:19:32.501 INFO:teuthology.orchestra.run.smithi122.stdout:(1/32): ceph-radosgw-19.0.0-2311.g687eba7a.el9. 12 MB/s | 10 MB 00:00 2024-04-17T02:19:32.551 INFO:teuthology.orchestra.run.smithi122.stdout:(2/32): ceph-selinux-19.0.0-2311.g687eba7a.el9. 517 kB/s | 25 kB 00:00 2024-04-17T02:19:32.617 INFO:teuthology.orchestra.run.smithi122.stdout:(3/32): libcephfs2-19.0.0-2311.g687eba7a.el9.x8 11 MB/s | 745 kB 00:00 2024-04-17T02:19:32.676 INFO:teuthology.orchestra.run.smithi122.stdout:(4/32): libradosstriper1-19.0.0-2311.g687eba7a. 8.4 MB/s | 501 kB 00:00 2024-04-17T02:19:32.976 INFO:teuthology.orchestra.run.smithi122.stdout:(5/32): librgw2-19.0.0-2311.g687eba7a.el9.x86_6 18 MB/s | 5.3 MB 00:00 2024-04-17T02:19:33.027 INFO:teuthology.orchestra.run.smithi122.stdout:(6/32): python3-ceph-argparse-19.0.0-2311.g687e 904 kB/s | 45 kB 00:00 2024-04-17T02:19:33.077 INFO:teuthology.orchestra.run.smithi122.stdout:(7/32): python3-ceph-common-19.0.0-2311.g687eba 2.6 MB/s | 131 kB 00:00 2024-04-17T02:19:33.136 INFO:teuthology.orchestra.run.smithi122.stdout:(8/32): python3-cephfs-19.0.0-2311.g687eba7a.el 2.7 MB/s | 162 kB 00:00 2024-04-17T02:19:33.186 INFO:teuthology.orchestra.run.smithi122.stdout:(9/32): python3-rados-19.0.0-2311.g687eba7a.el9 6.3 MB/s | 320 kB 00:00 2024-04-17T02:19:33.236 INFO:teuthology.orchestra.run.smithi122.stdout:(10/32): python3-rbd-19.0.0-2311.g687eba7a.el9. 5.9 MB/s | 299 kB 00:00 2024-04-17T02:19:33.296 INFO:teuthology.orchestra.run.smithi122.stdout:(11/32): python3-rgw-19.0.0-2311.g687eba7a.el9. 1.7 MB/s | 100 kB 00:00 2024-04-17T02:19:33.445 INFO:teuthology.orchestra.run.smithi122.stdout:(12/32): ceph-base-19.0.0-2311.g687eba7a.el9.x8 3.0 MB/s | 5.4 MB 00:01 2024-04-17T02:19:33.462 INFO:teuthology.orchestra.run.smithi122.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 635 kB/s | 106 kB 00:00 2024-04-17T02:19:33.495 INFO:teuthology.orchestra.run.smithi122.stdout:(14/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2024-04-17T02:19:33.521 INFO:teuthology.orchestra.run.smithi122.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 753 kB/s | 44 kB 00:00 2024-04-17T02:19:33.554 INFO:teuthology.orchestra.run.smithi122.stdout:(16/32): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2024-04-17T02:19:33.580 INFO:teuthology.orchestra.run.smithi122.stdout:(17/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2024-04-17T02:19:33.605 INFO:teuthology.orchestra.run.smithi122.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 824 kB/s | 41 kB 00:00 2024-04-17T02:19:33.630 INFO:teuthology.orchestra.run.smithi122.stdout:(19/32): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2024-04-17T02:19:33.655 INFO:teuthology.orchestra.run.smithi122.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 699 kB/s | 35 kB 00:00 2024-04-17T02:19:33.681 INFO:teuthology.orchestra.run.smithi122.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 923 kB/s | 46 kB 00:00 2024-04-17T02:19:33.906 INFO:teuthology.orchestra.run.smithi122.stdout:(22/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.2 MB/s | 309 kB 00:00 2024-04-17T02:19:33.956 INFO:teuthology.orchestra.run.smithi122.stdout:(23/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 520 kB/s | 26 kB 00:00 2024-04-17T02:19:34.015 INFO:teuthology.orchestra.run.smithi122.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 831 kB/s | 49 kB 00:00 2024-04-17T02:19:34.082 INFO:teuthology.orchestra.run.smithi122.stdout:(25/32): libarrow-9.0.0-10.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-04-17T02:19:34.107 INFO:teuthology.orchestra.run.smithi122.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 734 kB/s | 67 kB 00:00 2024-04-17T02:19:34.141 INFO:teuthology.orchestra.run.smithi122.stdout:(27/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 14 MB/s | 838 kB 00:00 2024-04-17T02:19:34.174 INFO:teuthology.orchestra.run.smithi122.stdout:(28/32): re2-20211101-3.el9.x86_64.rpm 2.8 MB/s | 192 kB 00:00 2024-04-17T02:19:34.216 INFO:teuthology.orchestra.run.smithi122.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-04-17T02:19:34.517 INFO:teuthology.orchestra.run.smithi122.stdout:(30/32): librbd1-19.0.0-2311.g687eba7a.el9.x86_ 10 MB/s | 3.1 MB 00:00 2024-04-17T02:19:34.717 INFO:teuthology.orchestra.run.smithi122.stdout:(31/32): librados2-19.0.0-2311.g687eba7a.el9.x8 6.2 MB/s | 3.4 MB 00:00 2024-04-17T02:19:35.059 INFO:teuthology.orchestra.run.smithi122.stdout:(32/32): ceph-common-19.0.0-2311.g687eba7a.el9. 6.2 MB/s | 21 MB 00:03 2024-04-17T02:19:35.062 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-04-17T02:19:35.062 INFO:teuthology.orchestra.run.smithi122.stdout:Total 17 MB/s | 60 MB 00:03 2024-04-17T02:19:35.063 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-04-17T02:19:35.098 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-04-17T02:19:35.098 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-04-17T02:19:35.169 INFO:teuthology.orchestra.run.smithi017.stdout:(32/32): libarrow-9.0.0-10.el9.x86_64.rpm 493 kB/s | 4.4 MB 00:09 2024-04-17T02:19:35.173 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-04-17T02:19:35.174 INFO:teuthology.orchestra.run.smithi017.stdout:Total 5.0 MB/s | 60 MB 00:12 2024-04-17T02:19:35.174 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-04-17T02:19:35.216 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-04-17T02:19:35.216 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-04-17T02:19:35.579 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-04-17T02:19:35.579 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-04-17T02:19:35.722 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-04-17T02:19:35.723 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-04-17T02:19:37.082 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-04-17T02:19:37.155 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-04-17T02:19:37.197 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-04-17T02:19:37.215 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-04-17T02:19:37.222 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-04-17T02:19:37.245 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-17T02:19:37.262 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-17T02:19:37.308 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-04-17T02:19:37.340 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-04-17T02:19:37.365 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-04-17T02:19:37.388 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-17T02:19:37.405 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-17T02:19:37.447 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-17T02:19:37.510 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-17T02:19:37.564 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-17T02:19:37.619 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-17T02:19:37.908 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-04-17T02:19:37.957 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : librados2-2:19.0.0-2311.g687eba7a.el9.x86_64 7/34 2024-04-17T02:19:37.968 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-04-17T02:19:38.026 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librados2-2:19.0.0-2311.g687eba7a.el9.x86_64 7/34 2024-04-17T02:19:38.049 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librados2-2:19.0.0-2311.g687eba7a.el9.x86_64 7/34 2024-04-17T02:19:38.117 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-2:19.0.0-2311.g687eba7a.el9.x86_64 7/34 2024-04-17T02:19:38.224 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rados-2:19.0.0-2311.g687eba7a.el9.x86_64 8/34 2024-04-17T02:19:38.251 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephfs2-2:19.0.0-2311.g687eba7a.el9.x86_64 9/34 2024-04-17T02:19:38.284 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rados-2:19.0.0-2311.g687eba7a.el9.x86_64 8/34 2024-04-17T02:19:38.296 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libcephfs2-2:19.0.0-2311.g687eba7a.el9.x86_64 9/34 2024-04-17T02:19:38.325 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-04-17T02:19:38.369 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs2-2:19.0.0-2311.g687eba7a.el9.x86_64 9/34 2024-04-17T02:19:38.369 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-ceph-argparse-2:19.0.0-2311.g687eba7a.el9. 11/34 2024-04-17T02:19:38.432 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephfs2-2:19.0.0-2311.g687eba7a.el9.x86_64 9/34 2024-04-17T02:19:38.433 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cephfs-2:19.0.0-2311.g687eba7a.el9.x86_64 12/34 2024-04-17T02:19:38.453 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libradosstriper1-2:19.0.0-2311.g687eba7a.el9.x86_6 13/34 2024-04-17T02:19:38.460 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-04-17T02:19:38.504 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-argparse-2:19.0.0-2311.g687eba7a.el9. 11/34 2024-04-17T02:19:38.516 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2311.g687eba7a.el9.x86_6 13/34 2024-04-17T02:19:38.551 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-04-17T02:19:38.574 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cephfs-2:19.0.0-2311.g687eba7a.el9.x86_64 12/34 2024-04-17T02:19:38.596 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libradosstriper1-2:19.0.0-2311.g687eba7a.el9.x86_6 13/34 2024-04-17T02:19:38.645 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2311.g687eba7a.el9.x86_6 13/34 2024-04-17T02:19:38.663 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-04-17T02:19:38.677 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-04-17T02:19:38.694 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/34 2024-04-17T02:19:38.738 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-04-17T02:19:38.767 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-04-17T02:19:38.788 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-04-17T02:19:38.796 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 19/34 2024-04-17T02:19:38.820 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/34 2024-04-17T02:19:38.829 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-04-17T02:19:38.861 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-04-17T02:19:38.902 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-04-17T02:19:38.931 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 19/34 2024-04-17T02:19:38.963 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-04-17T02:19:39.150 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-04-17T02:19:39.184 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : librbd1-2:19.0.0-2311.g687eba7a.el9.x86_64 22/34 2024-04-17T02:19:39.275 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librbd1-2:19.0.0-2311.g687eba7a.el9.x86_64 22/34 2024-04-17T02:19:39.291 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-04-17T02:19:39.305 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rbd-2:19.0.0-2311.g687eba7a.el9.x86_64 23/34 2024-04-17T02:19:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librbd1-2:19.0.0-2311.g687eba7a.el9.x86_64 22/34 2024-04-17T02:19:39.349 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-04-17T02:19:39.409 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-2:19.0.0-2311.g687eba7a.el9.x86_64 22/34 2024-04-17T02:19:39.440 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rbd-2:19.0.0-2311.g687eba7a.el9.x86_64 23/34 2024-04-17T02:19:39.478 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-04-17T02:19:39.816 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-04-17T02:19:39.845 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librgw2-2:19.0.0-2311.g687eba7a.el9.x86_64 26/34 2024-04-17T02:19:39.916 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librgw2-2:19.0.0-2311.g687eba7a.el9.x86_64 26/34 2024-04-17T02:19:39.970 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-04-17T02:19:40.004 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librgw2-2:19.0.0-2311.g687eba7a.el9.x86_64 26/34 2024-04-17T02:19:40.008 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rgw-2:19.0.0-2311.g687eba7a.el9.x86_64 27/34 2024-04-17T02:19:40.038 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-ceph-common-2:19.0.0-2311.g687eba7a.el9.x8 28/34 2024-04-17T02:19:40.076 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librgw2-2:19.0.0-2311.g687eba7a.el9.x86_64 26/34 2024-04-17T02:19:40.177 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rgw-2:19.0.0-2311.g687eba7a.el9.x86_64 27/34 2024-04-17T02:19:40.206 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-common-2:19.0.0-2311.g687eba7a.el9.x8 28/34 2024-04-17T02:19:42.352 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-common-2:19.0.0-2311.g687eba7a.el9.x86_64 29/34 2024-04-17T02:19:42.393 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-common-2:19.0.0-2311.g687eba7a.el9.x86_64 29/34 2024-04-17T02:19:42.597 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:19.0.0-2311.g687eba7a.el9.x86_64 29/34 2024-04-17T02:19:42.636 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-common-2:19.0.0-2311.g687eba7a.el9.x86_64 29/34 2024-04-17T02:19:42.954 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-common-2:19.0.0-2311.g687eba7a.el9.x86_64 29/34 2024-04-17T02:19:42.988 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-base-2:19.0.0-2311.g687eba7a.el9.x86_64 30/34 2024-04-17T02:19:43.074 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-base-2:19.0.0-2311.g687eba7a.el9.x86_64 30/34 2024-04-17T02:19:43.074 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-17T02:19:43.074 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-17T02:19:43.074 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:19:43.114 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-selinux-2:19.0.0-2311.g687eba7a.el9.x86_64 31/34 2024-04-17T02:19:43.209 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:19.0.0-2311.g687eba7a.el9.x86_64 29/34 2024-04-17T02:19:43.247 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-base-2:19.0.0-2311.g687eba7a.el9.x86_64 30/34 2024-04-17T02:19:43.332 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-base-2:19.0.0-2311.g687eba7a.el9.x86_64 30/34 2024-04-17T02:19:43.332 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-17T02:19:43.332 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-17T02:19:43.332 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:19:43.399 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-selinux-2:19.0.0-2311.g687eba7a.el9.x86_64 31/34 2024-04-17T02:19:52.900 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2311.g687eba7a.el9.x86_64 31/34 2024-04-17T02:19:52.900 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /sys 2024-04-17T02:19:52.900 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /proc 2024-04-17T02:19:52.900 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /mnt 2024-04-17T02:19:52.900 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /var/tmp 2024-04-17T02:19:52.900 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /home 2024-04-17T02:19:52.900 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /root 2024-04-17T02:19:52.900 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /tmp 2024-04-17T02:19:52.900 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:19:53.215 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2311.g687eba7a.el9.x86_64 31/34 2024-04-17T02:19:53.215 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /sys 2024-04-17T02:19:53.215 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /proc 2024-04-17T02:19:53.215 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /mnt 2024-04-17T02:19:53.215 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /var/tmp 2024-04-17T02:19:53.215 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /home 2024-04-17T02:19:53.215 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /root 2024-04-17T02:19:53.215 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /tmp 2024-04-17T02:19:53.215 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:19:53.876 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-radosgw-2:19.0.0-2311.g687eba7a.el9.x86_64 32/34 2024-04-17T02:19:53.902 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2311.g687eba7a.el9.x86_64 32/34 2024-04-17T02:19:53.902 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-17T02:19:53.902 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-17T02:19:53.902 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-17T02:19:53.902 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-17T02:19:53.902 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:19:53.904 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-17T02:19:53.987 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-17T02:19:53.988 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-17T02:19:54.204 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-radosgw-2:19.0.0-2311.g687eba7a.el9.x86_64 32/34 2024-04-17T02:19:54.229 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2311.g687eba7a.el9.x86_64 32/34 2024-04-17T02:19:54.230 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-17T02:19:54.230 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-17T02:19:54.230 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-17T02:19:54.230 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-17T02:19:54.230 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:19:54.231 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-17T02:19:54.316 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-17T02:19:54.316 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-17T02:19:55.183 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-17T02:19:55.183 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-base-2:19.0.0-2311.g687eba7a.el9.x86_64 1/34 2024-04-17T02:19:55.184 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-common-2:19.0.0-2311.g687eba7a.el9.x86_64 2/34 2024-04-17T02:19:55.184 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-radosgw-2:19.0.0-2311.g687eba7a.el9.x86_64 3/34 2024-04-17T02:19:55.184 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-selinux-2:19.0.0-2311.g687eba7a.el9.x86_64 4/34 2024-04-17T02:19:55.184 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephfs2-2:19.0.0-2311.g687eba7a.el9.x86_64 5/34 2024-04-17T02:19:55.184 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libradosstriper1-2:19.0.0-2311.g687eba7a.el9.x86_6 6/34 2024-04-17T02:19:55.184 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librgw2-2:19.0.0-2311.g687eba7a.el9.x86_64 7/34 2024-04-17T02:19:55.184 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2311.g687eba7a.el9. 8/34 2024-04-17T02:19:55.184 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-ceph-common-2:19.0.0-2311.g687eba7a.el9.x8 9/34 2024-04-17T02:19:55.184 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cephfs-2:19.0.0-2311.g687eba7a.el9.x86_64 10/34 2024-04-17T02:19:55.184 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rados-2:19.0.0-2311.g687eba7a.el9.x86_64 11/34 2024-04-17T02:19:55.184 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rbd-2:19.0.0-2311.g687eba7a.el9.x86_64 12/34 2024-04-17T02:19:55.184 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rgw-2:19.0.0-2311.g687eba7a.el9.x86_64 13/34 2024-04-17T02:19:55.184 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-04-17T02:19:55.184 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-04-17T02:19:55.185 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-04-17T02:19:55.185 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-04-17T02:19:55.185 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-04-17T02:19:55.185 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-04-17T02:19:55.185 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-04-17T02:19:55.185 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-04-17T02:19:55.185 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-04-17T02:19:55.185 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-04-17T02:19:55.185 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-04-17T02:19:55.185 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-04-17T02:19:55.186 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-04-17T02:19:55.186 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-04-17T02:19:55.186 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-04-17T02:19:55.186 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-04-17T02:19:55.187 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-04-17T02:19:55.187 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados2-2:19.0.0-2311.g687eba7a.el9.x86_64 31/34 2024-04-17T02:19:55.187 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-04-17T02:19:55.187 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librbd1-2:19.0.0-2311.g687eba7a.el9.x86_64 33/34 2024-04-17T02:19:55.492 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-17T02:19:55.492 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-base-2:19.0.0-2311.g687eba7a.el9.x86_64 1/34 2024-04-17T02:19:55.492 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-common-2:19.0.0-2311.g687eba7a.el9.x86_64 2/34 2024-04-17T02:19:55.492 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-radosgw-2:19.0.0-2311.g687eba7a.el9.x86_64 3/34 2024-04-17T02:19:55.492 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-selinux-2:19.0.0-2311.g687eba7a.el9.x86_64 4/34 2024-04-17T02:19:55.492 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs2-2:19.0.0-2311.g687eba7a.el9.x86_64 5/34 2024-04-17T02:19:55.492 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libradosstriper1-2:19.0.0-2311.g687eba7a.el9.x86_6 6/34 2024-04-17T02:19:55.493 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librgw2-2:19.0.0-2311.g687eba7a.el9.x86_64 7/34 2024-04-17T02:19:55.493 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2311.g687eba7a.el9. 8/34 2024-04-17T02:19:55.493 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-common-2:19.0.0-2311.g687eba7a.el9.x8 9/34 2024-04-17T02:19:55.493 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cephfs-2:19.0.0-2311.g687eba7a.el9.x86_64 10/34 2024-04-17T02:19:55.493 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rados-2:19.0.0-2311.g687eba7a.el9.x86_64 11/34 2024-04-17T02:19:55.493 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rbd-2:19.0.0-2311.g687eba7a.el9.x86_64 12/34 2024-04-17T02:19:55.493 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rgw-2:19.0.0-2311.g687eba7a.el9.x86_64 13/34 2024-04-17T02:19:55.493 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-04-17T02:19:55.493 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-04-17T02:19:55.493 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-04-17T02:19:55.493 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-04-17T02:19:55.493 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-04-17T02:19:55.493 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-04-17T02:19:55.493 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-04-17T02:19:55.493 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-04-17T02:19:55.494 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-04-17T02:19:55.494 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-04-17T02:19:55.494 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-04-17T02:19:55.494 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-04-17T02:19:55.494 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-04-17T02:19:55.494 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-04-17T02:19:55.495 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-04-17T02:19:55.495 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-04-17T02:19:55.495 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-04-17T02:19:55.495 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-2:19.0.0-2311.g687eba7a.el9.x86_64 31/34 2024-04-17T02:19:55.495 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-04-17T02:19:55.495 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-2:19.0.0-2311.g687eba7a.el9.x86_64 33/34 2024-04-17T02:19:56.256 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-04-17T02:19:56.256 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:19:56.256 INFO:teuthology.orchestra.run.smithi122.stdout:Upgraded: 2024-04-17T02:19:56.256 INFO:teuthology.orchestra.run.smithi122.stdout: librados2-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:19:56.256 INFO:teuthology.orchestra.run.smithi122.stdout: librbd1-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:19:56.256 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-04-17T02:19:56.257 INFO:teuthology.orchestra.run.smithi122.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-17T02:19:56.257 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-base-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:19:56.257 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-common-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:19:56.257 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-radosgw-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:19:56.257 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-selinux-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:19:56.257 INFO:teuthology.orchestra.run.smithi122.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-17T02:19:56.258 INFO:teuthology.orchestra.run.smithi122.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-17T02:19:56.258 INFO:teuthology.orchestra.run.smithi122.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-17T02:19:56.258 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs2-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:19:56.258 INFO:teuthology.orchestra.run.smithi122.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-17T02:19:56.258 INFO:teuthology.orchestra.run.smithi122.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-17T02:19:56.259 INFO:teuthology.orchestra.run.smithi122.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-17T02:19:56.259 INFO:teuthology.orchestra.run.smithi122.stdout: libradosstriper1-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:19:56.259 INFO:teuthology.orchestra.run.smithi122.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-17T02:19:56.259 INFO:teuthology.orchestra.run.smithi122.stdout: librgw2-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:19:56.259 INFO:teuthology.orchestra.run.smithi122.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-17T02:19:56.259 INFO:teuthology.orchestra.run.smithi122.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-17T02:19:56.259 INFO:teuthology.orchestra.run.smithi122.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-17T02:19:56.260 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-argparse-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:19:56.260 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-common-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:19:56.260 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cephfs-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:19:56.260 INFO:teuthology.orchestra.run.smithi122.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-17T02:19:56.260 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rados-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:19:56.260 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rbd-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:19:56.261 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rgw-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:19:56.261 INFO:teuthology.orchestra.run.smithi122.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-17T02:19:56.261 INFO:teuthology.orchestra.run.smithi122.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-17T02:19:56.261 INFO:teuthology.orchestra.run.smithi122.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-17T02:19:56.261 INFO:teuthology.orchestra.run.smithi122.stdout: re2-1:20211101-3.el9.x86_64 2024-04-17T02:19:56.261 INFO:teuthology.orchestra.run.smithi122.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-17T02:19:56.262 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:19:56.262 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-04-17T02:19:56.495 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-04-17T02:19:56.496 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:19:56.496 INFO:teuthology.orchestra.run.smithi017.stdout:Upgraded: 2024-04-17T02:19:56.496 INFO:teuthology.orchestra.run.smithi017.stdout: librados2-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:19:56.496 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:19:56.496 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-04-17T02:19:56.496 INFO:teuthology.orchestra.run.smithi017.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-17T02:19:56.496 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:19:56.496 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:19:56.496 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:19:56.496 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:19:56.496 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-17T02:19:56.496 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-17T02:19:56.496 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-17T02:19:56.497 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:19:56.497 INFO:teuthology.orchestra.run.smithi017.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-17T02:19:56.497 INFO:teuthology.orchestra.run.smithi017.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-17T02:19:56.497 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-17T02:19:56.497 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:19:56.497 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-17T02:19:56.497 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:19:56.497 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-17T02:19:56.497 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-17T02:19:56.497 INFO:teuthology.orchestra.run.smithi017.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-17T02:19:56.497 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:19:56.497 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:19:56.497 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:19:56.497 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-17T02:19:56.498 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:19:56.498 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:19:56.498 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:19:56.498 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-17T02:19:56.498 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-17T02:19:56.498 INFO:teuthology.orchestra.run.smithi017.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-17T02:19:56.498 INFO:teuthology.orchestra.run.smithi017.stdout: re2-1:20211101-3.el9.x86_64 2024-04-17T02:19:56.498 INFO:teuthology.orchestra.run.smithi017.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-17T02:19:56.498 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:19:56.498 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-04-17T02:19:56.648 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-test 2024-04-17T02:19:56.868 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-test 2024-04-17T02:19:57.243 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:00:29 ago on Wed 17 Apr 2024 02:19:28 AM UTC. 2024-04-17T02:19:57.398 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-04-17T02:19:57.398 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-17T02:19:57.398 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-04-17T02:19:57.398 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-17T02:19:57.399 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-04-17T02:19:57.399 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-test x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 48 M 2024-04-17T02:19:57.399 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-04-17T02:19:57.399 INFO:teuthology.orchestra.run.smithi122.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-17T02:19:57.399 INFO:teuthology.orchestra.run.smithi122.stdout: libcephsqlite x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 163 k 2024-04-17T02:19:57.399 INFO:teuthology.orchestra.run.smithi122.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-17T02:19:57.399 INFO:teuthology.orchestra.run.smithi122.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-17T02:19:57.399 INFO:teuthology.orchestra.run.smithi122.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-17T02:19:57.399 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:19:57.399 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-04-17T02:19:57.399 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-17T02:19:57.399 INFO:teuthology.orchestra.run.smithi122.stdout:Install 6 Packages 2024-04-17T02:19:57.399 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:19:57.400 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 49 M 2024-04-17T02:19:57.400 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 208 M 2024-04-17T02:19:57.400 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-04-17T02:19:57.467 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:00:37 ago on Wed 17 Apr 2024 02:19:20 AM UTC. 2024-04-17T02:19:57.630 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-04-17T02:19:57.630 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-04-17T02:19:57.630 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-04-17T02:19:57.631 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-04-17T02:19:57.631 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-04-17T02:19:57.631 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 48 M 2024-04-17T02:19:57.631 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-04-17T02:19:57.631 INFO:teuthology.orchestra.run.smithi017.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-17T02:19:57.631 INFO:teuthology.orchestra.run.smithi017.stdout: libcephsqlite x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 163 k 2024-04-17T02:19:57.631 INFO:teuthology.orchestra.run.smithi017.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-17T02:19:57.631 INFO:teuthology.orchestra.run.smithi017.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-17T02:19:57.631 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-17T02:19:57.631 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:19:57.631 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-04-17T02:19:57.631 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-04-17T02:19:57.631 INFO:teuthology.orchestra.run.smithi017.stdout:Install 6 Packages 2024-04-17T02:19:57.631 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:19:57.632 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 49 M 2024-04-17T02:19:57.632 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 208 M 2024-04-17T02:19:57.632 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-04-17T02:19:57.677 INFO:teuthology.orchestra.run.smithi122.stdout:(1/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.4 MB/s | 217 kB 00:00 2024-04-17T02:19:57.727 INFO:teuthology.orchestra.run.smithi122.stdout:(2/6): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 300 kB 00:00 2024-04-17T02:19:57.760 INFO:teuthology.orchestra.run.smithi122.stdout:(3/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2024-04-17T02:19:57.794 INFO:teuthology.orchestra.run.smithi122.stdout:(4/6): libcephsqlite-19.0.0-2311.g687eba7a.el9. 598 kB/s | 163 kB 00:00 2024-04-17T02:19:57.944 INFO:teuthology.orchestra.run.smithi122.stdout:(5/6): jq-1.6-16.el9.x86_64.rpm 1.0 MB/s | 187 kB 00:00 2024-04-17T02:19:58.079 INFO:teuthology.orchestra.run.smithi017.stdout:(1/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.3 MB/s | 217 kB 00:00 2024-04-17T02:19:58.121 INFO:teuthology.orchestra.run.smithi017.stdout:(2/6): socat-1.7.4.1-5.el9.x86_64.rpm 7.1 MB/s | 300 kB 00:00 2024-04-17T02:19:58.146 INFO:teuthology.orchestra.run.smithi017.stdout:(3/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.4 MB/s | 63 kB 00:00 2024-04-17T02:19:58.296 INFO:teuthology.orchestra.run.smithi017.stdout:(4/6): libcephsqlite-19.0.0-2311.g687eba7a.el9. 425 kB/s | 163 kB 00:00 2024-04-17T02:19:59.005 INFO:teuthology.orchestra.run.smithi017.stdout:(5/6): jq-1.6-16.el9.x86_64.rpm 218 kB/s | 187 kB 00:00 2024-04-17T02:20:00.519 INFO:teuthology.orchestra.run.smithi122.stdout:(6/6): ceph-test-19.0.0-2311.g687eba7a.el9.x86_ 16 MB/s | 48 MB 00:02 2024-04-17T02:20:00.523 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-04-17T02:20:00.523 INFO:teuthology.orchestra.run.smithi122.stdout:Total 16 MB/s | 49 MB 00:03 2024-04-17T02:20:00.538 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-04-17T02:20:00.558 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-04-17T02:20:00.558 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-04-17T02:20:00.952 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-04-17T02:20:00.953 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-04-17T02:20:01.522 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-04-17T02:20:01.603 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-04-17T02:20:01.637 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-04-17T02:20:01.668 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-04-17T02:20:01.711 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-04-17T02:20:01.731 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephsqlite-2:19.0.0-2311.g687eba7a.el9.x86_64 5/6 2024-04-17T02:20:05.038 INFO:teuthology.orchestra.run.smithi017.stdout:(6/6): ceph-test-19.0.0-2311.g687eba7a.el9.x86_ 6.8 MB/s | 48 MB 00:07 2024-04-17T02:20:05.041 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-04-17T02:20:05.041 INFO:teuthology.orchestra.run.smithi017.stdout:Total 6.6 MB/s | 49 MB 00:07 2024-04-17T02:20:05.055 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-04-17T02:20:05.076 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-04-17T02:20:05.076 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-04-17T02:20:05.478 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-04-17T02:20:05.479 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-04-17T02:20:06.090 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-04-17T02:20:06.173 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-04-17T02:20:06.206 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-04-17T02:20:06.244 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-04-17T02:20:06.284 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2311.g687eba7a.el9.x86_64 5/6 2024-04-17T02:20:06.289 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-04-17T02:20:06.316 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephsqlite-2:19.0.0-2311.g687eba7a.el9.x86_64 5/6 2024-04-17T02:20:06.355 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-test-2:19.0.0-2311.g687eba7a.el9.x86_64 6/6 2024-04-17T02:20:08.831 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-test-2:19.0.0-2311.g687eba7a.el9.x86_64 6/6 2024-04-17T02:20:08.831 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-test-2:19.0.0-2311.g687eba7a.el9.x86_64 1/6 2024-04-17T02:20:08.831 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephsqlite-2:19.0.0-2311.g687eba7a.el9.x86_64 2/6 2024-04-17T02:20:08.831 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-04-17T02:20:08.831 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/6 2024-04-17T02:20:08.832 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/6 2024-04-17T02:20:09.204 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : jq-1.6-16.el9.x86_64 6/6 2024-04-17T02:20:09.204 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:20:09.204 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-04-17T02:20:09.204 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-test-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:20:09.204 INFO:teuthology.orchestra.run.smithi122.stdout: jq-1.6-16.el9.x86_64 2024-04-17T02:20:09.204 INFO:teuthology.orchestra.run.smithi122.stdout: libcephsqlite-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:20:09.204 INFO:teuthology.orchestra.run.smithi122.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-17T02:20:09.204 INFO:teuthology.orchestra.run.smithi122.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-17T02:20:09.204 INFO:teuthology.orchestra.run.smithi122.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-17T02:20:09.204 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:20:09.204 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-04-17T02:20:09.532 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph 2024-04-17T02:20:10.140 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:00:42 ago on Wed 17 Apr 2024 02:19:28 AM UTC. 2024-04-17T02:20:10.312 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-04-17T02:20:10.315 INFO:teuthology.orchestra.run.smithi122.stdout:========================================================================================= 2024-04-17T02:20:10.315 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-04-17T02:20:10.315 INFO:teuthology.orchestra.run.smithi122.stdout:========================================================================================= 2024-04-17T02:20:10.315 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-04-17T02:20:10.315 INFO:teuthology.orchestra.run.smithi122.stdout: ceph x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 6.6 k 2024-04-17T02:20:10.315 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-04-17T02:20:10.315 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mds x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 2.4 M 2024-04-17T02:20:10.315 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 1.5 M 2024-04-17T02:20:10.315 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2311.g687eba7a.el9 ceph-noarch 248 k 2024-04-17T02:20:10.316 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mon x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 4.7 M 2024-04-17T02:20:10.316 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-osd x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 17 M 2024-04-17T02:20:10.316 INFO:teuthology.orchestra.run.smithi122.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-04-17T02:20:10.316 INFO:teuthology.orchestra.run.smithi122.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-17T02:20:10.316 INFO:teuthology.orchestra.run.smithi122.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-17T02:20:10.316 INFO:teuthology.orchestra.run.smithi122.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-17T02:20:10.316 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-17T02:20:10.316 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-17T02:20:10.316 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-17T02:20:10.316 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-17T02:20:10.316 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-17T02:20:10.316 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-17T02:20:10.316 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-17T02:20:10.316 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-17T02:20:10.317 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-17T02:20:10.317 INFO:teuthology.orchestra.run.smithi122.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-17T02:20:10.317 INFO:teuthology.orchestra.run.smithi122.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-17T02:20:10.317 INFO:teuthology.orchestra.run.smithi122.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-17T02:20:10.317 INFO:teuthology.orchestra.run.smithi122.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-17T02:20:10.317 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-17T02:20:10.317 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-17T02:20:10.317 INFO:teuthology.orchestra.run.smithi122.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-17T02:20:10.317 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-17T02:20:10.317 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-17T02:20:10.317 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-17T02:20:10.317 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-17T02:20:10.317 INFO:teuthology.orchestra.run.smithi122.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-17T02:20:10.317 INFO:teuthology.orchestra.run.smithi122.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-17T02:20:10.317 INFO:teuthology.orchestra.run.smithi122.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-17T02:20:10.318 INFO:teuthology.orchestra.run.smithi122.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-17T02:20:10.318 INFO:teuthology.orchestra.run.smithi122.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-17T02:20:10.318 INFO:teuthology.orchestra.run.smithi122.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-17T02:20:10.318 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:20:10.318 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-04-17T02:20:10.318 INFO:teuthology.orchestra.run.smithi122.stdout:========================================================================================= 2024-04-17T02:20:10.318 INFO:teuthology.orchestra.run.smithi122.stdout:Install 36 Packages 2024-04-17T02:20:10.318 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:20:10.319 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 30 M 2024-04-17T02:20:10.319 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 107 M 2024-04-17T02:20:10.319 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-04-17T02:20:10.906 INFO:teuthology.orchestra.run.smithi122.stdout:(1/36): ceph-19.0.0-2311.g687eba7a.el9.x86_64.r 21 kB/s | 6.6 kB 00:00 2024-04-17T02:20:11.137 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2311.g687eba7a.el9.x86_64 5/6 2024-04-17T02:20:11.218 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-test-2:19.0.0-2311.g687eba7a.el9.x86_64 6/6 2024-04-17T02:20:11.823 INFO:teuthology.orchestra.run.smithi122.stdout:(2/36): ceph-mgr-19.0.0-2311.g687eba7a.el9.x86_ 1.2 MB/s | 1.5 MB 00:01 2024-04-17T02:20:11.949 INFO:teuthology.orchestra.run.smithi122.stdout:(3/36): ceph-mds-19.0.0-2311.g687eba7a.el9.x86_ 1.7 MB/s | 2.4 MB 00:01 2024-04-17T02:20:12.066 INFO:teuthology.orchestra.run.smithi122.stdout:(4/36): ceph-mgr-modules-core-19.0.0-2311.g687e 2.1 MB/s | 248 kB 00:00 2024-04-17T02:20:12.191 INFO:teuthology.orchestra.run.smithi122.stdout:(5/36): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 187 kB 00:00 2024-04-17T02:20:12.241 INFO:teuthology.orchestra.run.smithi122.stdout:(6/36): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-04-17T02:20:12.275 INFO:teuthology.orchestra.run.smithi122.stdout:(7/36): python3-markupsafe-1.1.1-12.el9.x86_64. 948 kB/s | 32 kB 00:00 2024-04-17T02:20:12.317 INFO:teuthology.orchestra.run.smithi122.stdout:(8/36): python3-pytz-2021.1-5.el9.noarch.rpm 1.1 MB/s | 47 kB 00:00 2024-04-17T02:20:12.359 INFO:teuthology.orchestra.run.smithi122.stdout:(9/36): python3-toml-0.10.2-6.el9.noarch.rpm 922 kB/s | 39 kB 00:00 2024-04-17T02:20:12.417 INFO:teuthology.orchestra.run.smithi122.stdout:(10/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.0 MB/s | 241 kB 00:00 2024-04-17T02:20:12.534 INFO:teuthology.orchestra.run.smithi122.stdout:(11/36): python3-cryptography-36.0.1-4.el9.x86_ 9.8 MB/s | 1.1 MB 00:00 2024-04-17T02:20:12.576 INFO:teuthology.orchestra.run.smithi122.stdout:(12/36): python3-ply-3.11-14.el9.noarch.rpm 2.4 MB/s | 103 kB 00:00 2024-04-17T02:20:12.626 INFO:teuthology.orchestra.run.smithi122.stdout:(13/36): python3-pycparser-2.20-6.el9.noarch.rp 2.4 MB/s | 124 kB 00:00 2024-04-17T02:20:12.677 INFO:teuthology.orchestra.run.smithi122.stdout:(14/36): python3-urllib3-1.26.5-5.el9.noarch.rp 3.7 MB/s | 187 kB 00:00 2024-04-17T02:20:12.910 INFO:teuthology.orchestra.run.smithi122.stdout:(15/36): python3-requests-2.25.1-8.el9.noarch.r 535 kB/s | 125 kB 00:00 2024-04-17T02:20:12.977 INFO:teuthology.orchestra.run.smithi122.stdout:(16/36): lua-devel-5.4.4-4.el9.x86_64.rpm 334 kB/s | 22 kB 00:00 2024-04-17T02:20:13.203 INFO:teuthology.orchestra.run.smithi122.stdout:(17/36): luarocks-3.9.2-1.el9.noarch.rpm 671 kB/s | 151 kB 00:00 2024-04-17T02:20:13.270 INFO:teuthology.orchestra.run.smithi122.stdout:(18/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 654 kB/s | 43 kB 00:00 2024-04-17T02:20:13.346 INFO:teuthology.orchestra.run.smithi122.stdout:(19/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-04-17T02:20:13.446 INFO:teuthology.orchestra.run.smithi122.stdout:(20/36): python3-cherrypy-18.6.1-2.el9.noarch.r 3.5 MB/s | 358 kB 00:00 2024-04-17T02:20:13.504 INFO:teuthology.orchestra.run.smithi122.stdout:(21/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 183 kB/s | 11 kB 00:00 2024-04-17T02:20:13.562 INFO:teuthology.orchestra.run.smithi122.stdout:(22/36): python3-jaraco-classes-3.2.1-5.el9.noa 304 kB/s | 18 kB 00:00 2024-04-17T02:20:13.598 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-test-2:19.0.0-2311.g687eba7a.el9.x86_64 6/6 2024-04-17T02:20:13.598 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-test-2:19.0.0-2311.g687eba7a.el9.x86_64 1/6 2024-04-17T02:20:13.598 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephsqlite-2:19.0.0-2311.g687eba7a.el9.x86_64 2/6 2024-04-17T02:20:13.598 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-04-17T02:20:13.598 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/6 2024-04-17T02:20:13.598 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/6 2024-04-17T02:20:13.630 INFO:teuthology.orchestra.run.smithi122.stdout:(23/36): ceph-mon-19.0.0-2311.g687eba7a.el9.x86 1.7 MB/s | 4.7 MB 00:02 2024-04-17T02:20:13.655 INFO:teuthology.orchestra.run.smithi122.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 251 kB/s | 23 kB 00:00 2024-04-17T02:20:13.722 INFO:teuthology.orchestra.run.smithi122.stdout:(25/36): python3-jaraco-text-3.2.0-6.el9.noarch 293 kB/s | 20 kB 00:00 2024-04-17T02:20:13.756 INFO:teuthology.orchestra.run.smithi122.stdout:(26/36): python3-jaraco-functools-3.5.0-2.el9.n 154 kB/s | 19 kB 00:00 2024-04-17T02:20:13.781 INFO:teuthology.orchestra.run.smithi122.stdout:(27/36): python3-logutils-0.3.5-21.el9.noarch.r 789 kB/s | 46 kB 00:00 2024-04-17T02:20:13.848 INFO:teuthology.orchestra.run.smithi122.stdout:(28/36): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-04-17T02:20:13.965 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : jq-1.6-16.el9.x86_64 6/6 2024-04-17T02:20:13.965 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:20:13.965 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-04-17T02:20:13.965 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:20:13.965 INFO:teuthology.orchestra.run.smithi017.stdout: jq-1.6-16.el9.x86_64 2024-04-17T02:20:13.965 INFO:teuthology.orchestra.run.smithi017.stdout: libcephsqlite-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:20:13.965 INFO:teuthology.orchestra.run.smithi017.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-17T02:20:13.966 INFO:teuthology.orchestra.run.smithi017.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-17T02:20:13.966 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-17T02:20:13.966 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:20:13.966 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-04-17T02:20:14.032 INFO:teuthology.orchestra.run.smithi122.stdout:(29/36): ceph-osd-19.0.0-2311.g687eba7a.el9.x86 7.6 MB/s | 17 MB 00:02 2024-04-17T02:20:14.048 INFO:teuthology.orchestra.run.smithi122.stdout:(30/36): python3-more-itertools-8.12.0-2.el9.no 270 kB/s | 79 kB 00:00 2024-04-17T02:20:14.074 INFO:teuthology.orchestra.run.smithi122.stdout:(31/36): python3-portend-3.1.0-2.el9.noarch.rpm 73 kB/s | 16 kB 00:00 2024-04-17T02:20:14.132 INFO:teuthology.orchestra.run.smithi122.stdout:(32/36): python3-tempora-5.0.0-2.el9.noarch.rpm 614 kB/s | 36 kB 00:00 2024-04-17T02:20:14.199 INFO:teuthology.orchestra.run.smithi122.stdout:(33/36): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-04-17T02:20:14.224 INFO:teuthology.orchestra.run.smithi122.stdout:(34/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.5 MB/s | 427 kB 00:00 2024-04-17T02:20:14.250 INFO:teuthology.orchestra.run.smithi122.stdout:(35/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 413 kB/s | 90 kB 00:00 2024-04-17T02:20:14.261 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph 2024-04-17T02:20:14.275 INFO:teuthology.orchestra.run.smithi122.stdout:(36/36): python3-zc-lockfile-2.0-10.el9.noarch. 265 kB/s | 20 kB 00:00 2024-04-17T02:20:14.281 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-04-17T02:20:14.281 INFO:teuthology.orchestra.run.smithi122.stdout:Total 7.6 MB/s | 30 MB 00:03 2024-04-17T02:20:14.303 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-04-17T02:20:14.345 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-04-17T02:20:14.345 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-04-17T02:20:14.778 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-04-17T02:20:14.778 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-04-17T02:20:14.860 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:00:54 ago on Wed 17 Apr 2024 02:19:20 AM UTC. 2024-04-17T02:20:15.022 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-04-17T02:20:15.025 INFO:teuthology.orchestra.run.smithi017.stdout:========================================================================================= 2024-04-17T02:20:15.025 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-04-17T02:20:15.025 INFO:teuthology.orchestra.run.smithi017.stdout:========================================================================================= 2024-04-17T02:20:15.025 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-04-17T02:20:15.025 INFO:teuthology.orchestra.run.smithi017.stdout: ceph x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 6.6 k 2024-04-17T02:20:15.025 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-04-17T02:20:15.025 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 2.4 M 2024-04-17T02:20:15.025 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 1.5 M 2024-04-17T02:20:15.026 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2311.g687eba7a.el9 ceph-noarch 248 k 2024-04-17T02:20:15.026 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 4.7 M 2024-04-17T02:20:15.026 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 17 M 2024-04-17T02:20:15.026 INFO:teuthology.orchestra.run.smithi017.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-04-17T02:20:15.026 INFO:teuthology.orchestra.run.smithi017.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-17T02:20:15.026 INFO:teuthology.orchestra.run.smithi017.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-17T02:20:15.026 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-17T02:20:15.026 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-17T02:20:15.026 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-17T02:20:15.026 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-17T02:20:15.026 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-17T02:20:15.026 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-17T02:20:15.026 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-17T02:20:15.027 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-17T02:20:15.027 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-17T02:20:15.027 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-17T02:20:15.027 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-17T02:20:15.027 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-17T02:20:15.027 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-17T02:20:15.027 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-17T02:20:15.027 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-17T02:20:15.027 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-17T02:20:15.027 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-17T02:20:15.027 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-17T02:20:15.028 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-17T02:20:15.028 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-17T02:20:15.028 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-17T02:20:15.028 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-17T02:20:15.028 INFO:teuthology.orchestra.run.smithi017.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-17T02:20:15.028 INFO:teuthology.orchestra.run.smithi017.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-17T02:20:15.028 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-17T02:20:15.028 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-17T02:20:15.028 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-17T02:20:15.028 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:20:15.028 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-04-17T02:20:15.028 INFO:teuthology.orchestra.run.smithi017.stdout:========================================================================================= 2024-04-17T02:20:15.028 INFO:teuthology.orchestra.run.smithi017.stdout:Install 36 Packages 2024-04-17T02:20:15.029 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:20:15.029 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 30 M 2024-04-17T02:20:15.029 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 107 M 2024-04-17T02:20:15.030 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-04-17T02:20:15.909 INFO:teuthology.orchestra.run.smithi017.stdout:(1/36): ceph-19.0.0-2311.g687eba7a.el9.x86_64.r 23 kB/s | 6.6 kB 00:00 2024-04-17T02:20:16.120 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-04-17T02:20:16.177 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-04-17T02:20:16.218 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-04-17T02:20:16.247 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-04-17T02:20:16.317 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-04-17T02:20:16.317 INFO:teuthology.orchestra.run.smithi017.stdout:(2/36): ceph-mds-19.0.0-2311.g687eba7a.el9.x86_ 3.4 MB/s | 2.4 MB 00:00 2024-04-17T02:20:16.362 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-04-17T02:20:16.395 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-04-17T02:20:16.486 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-04-17T02:20:16.564 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-04-17T02:20:16.606 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-04-17T02:20:16.686 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-04-17T02:20:16.740 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 11/36 2024-04-17T02:20:16.778 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 12/36 2024-04-17T02:20:16.827 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-ply-3.11-14.el9.noarch 13/36 2024-04-17T02:20:16.887 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 14/36 2024-04-17T02:20:16.951 INFO:teuthology.orchestra.run.smithi017.stdout:(3/36): ceph-mon-19.0.0-2311.g687eba7a.el9.x86_ 4.5 MB/s | 4.7 MB 00:01 2024-04-17T02:20:17.043 INFO:teuthology.orchestra.run.smithi017.stdout:(4/36): ceph-mgr-modules-core-19.0.0-2311.g687e 2.7 MB/s | 248 kB 00:00 2024-04-17T02:20:17.073 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 15/36 2024-04-17T02:20:17.116 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 16/36 2024-04-17T02:20:17.162 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 17/36 2024-04-17T02:20:17.197 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 18/36 2024-04-17T02:20:17.228 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 19/36 2024-04-17T02:20:17.276 INFO:teuthology.orchestra.run.smithi017.stdout:(5/36): ceph-osd-19.0.0-2311.g687eba7a.el9.x86_ 18 MB/s | 17 MB 00:00 2024-04-17T02:20:17.296 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 20/36 2024-04-17T02:20:17.302 INFO:teuthology.orchestra.run.smithi017.stdout:(6/36): lua-5.4.4-4.el9.x86_64.rpm 722 kB/s | 187 kB 00:00 2024-04-17T02:20:17.329 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-17T02:20:17.361 INFO:teuthology.orchestra.run.smithi017.stdout:(7/36): ceph-mgr-19.0.0-2311.g687eba7a.el9.x86_ 882 kB/s | 1.5 MB 00:01 2024-04-17T02:20:17.363 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 22/36 2024-04-17T02:20:17.386 INFO:teuthology.orchestra.run.smithi017.stdout:(8/36): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 144 kB 00:00 2024-04-17T02:20:17.403 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 23/36 2024-04-17T02:20:17.411 INFO:teuthology.orchestra.run.smithi017.stdout:(9/36): python3-markupsafe-1.1.1-12.el9.x86_64. 290 kB/s | 32 kB 00:00 2024-04-17T02:20:17.436 INFO:teuthology.orchestra.run.smithi017.stdout:(10/36): python3-pytz-2021.1-5.el9.noarch.rpm 629 kB/s | 47 kB 00:00 2024-04-17T02:20:17.438 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/36 2024-04-17T02:20:17.462 INFO:teuthology.orchestra.run.smithi017.stdout:(11/36): python3-toml-0.10.2-6.el9.noarch.rpm 769 kB/s | 39 kB 00:00 2024-04-17T02:20:17.473 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 25/36 2024-04-17T02:20:17.486 INFO:teuthology.orchestra.run.smithi017.stdout:(12/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.1 MB/s | 241 kB 00:00 2024-04-17T02:20:17.545 INFO:teuthology.orchestra.run.smithi017.stdout:(13/36): python3-cryptography-36.0.1-4.el9.x86_ 11 MB/s | 1.1 MB 00:00 2024-04-17T02:20:17.562 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 26/36 2024-04-17T02:20:17.571 INFO:teuthology.orchestra.run.smithi017.stdout:(14/36): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2024-04-17T02:20:17.596 INFO:teuthology.orchestra.run.smithi017.stdout:(15/36): python3-pycparser-2.20-6.el9.noarch.rp 1.1 MB/s | 124 kB 00:00 2024-04-17T02:20:17.604 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/36 2024-04-17T02:20:17.621 INFO:teuthology.orchestra.run.smithi017.stdout:(16/36): python3-urllib3-1.26.5-5.el9.noarch.rp 2.4 MB/s | 187 kB 00:00 2024-04-17T02:20:17.676 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/36 2024-04-17T02:20:17.713 INFO:teuthology.orchestra.run.smithi017.stdout:(17/36): lua-devel-5.4.4-4.el9.x86_64.rpm 191 kB/s | 22 kB 00:00 2024-04-17T02:20:17.805 INFO:teuthology.orchestra.run.smithi017.stdout:(18/36): python3-requests-2.25.1-8.el9.noarch.r 597 kB/s | 125 kB 00:00 2024-04-17T02:20:17.821 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 29/36 2024-04-17T02:20:17.946 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-17T02:20:18.111 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2311.g687eba7a.el9. 31/36 2024-04-17T02:20:18.142 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-2:19.0.0-2311.g687eba7a.el9.x86_64 32/36 2024-04-17T02:20:18.169 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2311.g687eba7a.el9.x86_64 32/36 2024-04-17T02:20:18.169 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-17T02:20:18.169 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-17T02:20:18.169 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-17T02:20:18.169 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-17T02:20:18.169 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:20:18.438 INFO:teuthology.orchestra.run.smithi017.stdout:(19/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 62 kB/s | 43 kB 00:00 2024-04-17T02:20:18.547 INFO:teuthology.orchestra.run.smithi017.stdout:(20/36): luarocks-3.9.2-1.el9.noarch.rpm 163 kB/s | 151 kB 00:00 2024-04-17T02:20:18.572 INFO:teuthology.orchestra.run.smithi017.stdout:(21/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 224 kB/s | 172 kB 00:00 2024-04-17T02:20:18.656 INFO:teuthology.orchestra.run.smithi017.stdout:(22/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 98 kB/s | 11 kB 00:00 2024-04-17T02:20:18.690 INFO:teuthology.orchestra.run.smithi017.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 151 kB/s | 18 kB 00:00 2024-04-17T02:20:18.774 INFO:teuthology.orchestra.run.smithi017.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 198 kB/s | 23 kB 00:00 2024-04-17T02:20:18.799 INFO:teuthology.orchestra.run.smithi017.stdout:(25/36): python3-jaraco-functools-3.5.0-2.el9.n 179 kB/s | 19 kB 00:00 2024-04-17T02:20:18.874 INFO:teuthology.orchestra.run.smithi017.stdout:(26/36): python3-jaraco-text-3.2.0-6.el9.noarch 196 kB/s | 20 kB 00:00 2024-04-17T02:20:18.899 INFO:teuthology.orchestra.run.smithi017.stdout:(27/36): python3-logutils-0.3.5-21.el9.noarch.r 461 kB/s | 46 kB 00:00 2024-04-17T02:20:18.941 INFO:teuthology.orchestra.run.smithi017.stdout:(28/36): python3-cherrypy-18.6.1-2.el9.noarch.r 714 kB/s | 358 kB 00:00 2024-04-17T02:20:19.058 INFO:teuthology.orchestra.run.smithi017.stdout:(29/36): python3-portend-3.1.0-2.el9.noarch.rpm 141 kB/s | 16 kB 00:00 2024-04-17T02:20:19.092 INFO:teuthology.orchestra.run.smithi017.stdout:(30/36): python3-more-itertools-8.12.0-2.el9.no 362 kB/s | 79 kB 00:00 2024-04-17T02:20:19.192 INFO:teuthology.orchestra.run.smithi017.stdout:(31/36): python3-tempora-5.0.0-2.el9.noarch.rpm 357 kB/s | 36 kB 00:00 2024-04-17T02:20:19.259 INFO:teuthology.orchestra.run.smithi017.stdout:(32/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 448 kB/s | 90 kB 00:00 2024-04-17T02:20:19.367 INFO:teuthology.orchestra.run.smithi017.stdout:(33/36): python3-pecan-1.4.2-3.el9.noarch.rpm 582 kB/s | 272 kB 00:00 2024-04-17T02:20:19.468 INFO:teuthology.orchestra.run.smithi017.stdout:(34/36): python3-zc-lockfile-2.0-10.el9.noarch. 200 kB/s | 20 kB 00:00 2024-04-17T02:20:19.578 INFO:teuthology.orchestra.run.smithi017.stdout:(35/36): python3-webob-1.8.7-6.el9.noarch.rpm 598 kB/s | 230 kB 00:00 2024-04-17T02:20:19.601 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-osd-2:19.0.0-2311.g687eba7a.el9.x86_64 33/36 2024-04-17T02:20:19.629 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-osd-2:19.0.0-2311.g687eba7a.el9.x86_64 33/36 2024-04-17T02:20:19.629 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-17T02:20:19.629 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-17T02:20:19.629 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-17T02:20:19.630 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-17T02:20:19.630 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:20:19.868 INFO:teuthology.orchestra.run.smithi017.stdout:(36/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 701 kB/s | 427 kB 00:00 2024-04-17T02:20:19.874 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-04-17T02:20:19.874 INFO:teuthology.orchestra.run.smithi017.stdout:Total 6.2 MB/s | 30 MB 00:04 2024-04-17T02:20:19.900 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-04-17T02:20:19.946 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-04-17T02:20:19.947 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-04-17T02:20:20.069 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mon-2:19.0.0-2311.g687eba7a.el9.x86_64 34/36 2024-04-17T02:20:20.093 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mon-2:19.0.0-2311.g687eba7a.el9.x86_64 34/36 2024-04-17T02:20:20.093 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-17T02:20:20.093 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-17T02:20:20.093 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-17T02:20:20.094 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-17T02:20:20.094 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:20:20.311 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mds-2:19.0.0-2311.g687eba7a.el9.x86_64 35/36 2024-04-17T02:20:20.335 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mds-2:19.0.0-2311.g687eba7a.el9.x86_64 35/36 2024-04-17T02:20:20.335 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-17T02:20:20.335 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-17T02:20:20.335 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-17T02:20:20.335 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-17T02:20:20.335 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:20:20.368 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-04-17T02:20:20.368 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-04-17T02:20:20.392 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-2:19.0.0-2311.g687eba7a.el9.x86_64 36/36 2024-04-17T02:20:21.719 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-04-17T02:20:21.771 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-04-17T02:20:21.803 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-04-17T02:20:21.832 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-04-17T02:20:21.905 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-04-17T02:20:21.947 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-04-17T02:20:21.980 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-04-17T02:20:22.076 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-04-17T02:20:22.153 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-04-17T02:20:22.163 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-2:19.0.0-2311.g687eba7a.el9.x86_64 36/36 2024-04-17T02:20:22.163 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-2:19.0.0-2311.g687eba7a.el9.x86_64 1/36 2024-04-17T02:20:22.163 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mds-2:19.0.0-2311.g687eba7a.el9.x86_64 2/36 2024-04-17T02:20:22.163 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-2:19.0.0-2311.g687eba7a.el9.x86_64 3/36 2024-04-17T02:20:22.163 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mon-2:19.0.0-2311.g687eba7a.el9.x86_64 4/36 2024-04-17T02:20:22.163 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-osd-2:19.0.0-2311.g687eba7a.el9.x86_64 5/36 2024-04-17T02:20:22.163 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2311.g687eba7a.el9. 6/36 2024-04-17T02:20:22.164 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : lua-5.4.4-4.el9.x86_64 7/36 2024-04-17T02:20:22.164 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 8/36 2024-04-17T02:20:22.164 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 9/36 2024-04-17T02:20:22.164 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 10/36 2024-04-17T02:20:22.164 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 11/36 2024-04-17T02:20:22.164 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 12/36 2024-04-17T02:20:22.164 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 13/36 2024-04-17T02:20:22.164 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-ply-3.11-14.el9.noarch 14/36 2024-04-17T02:20:22.164 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 15/36 2024-04-17T02:20:22.164 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 16/36 2024-04-17T02:20:22.164 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 17/36 2024-04-17T02:20:22.164 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-04-17T02:20:22.164 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-04-17T02:20:22.165 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-04-17T02:20:22.165 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-17T02:20:22.165 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-04-17T02:20:22.165 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-04-17T02:20:22.165 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-04-17T02:20:22.165 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-04-17T02:20:22.165 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-04-17T02:20:22.165 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-04-17T02:20:22.165 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-04-17T02:20:22.165 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-04-17T02:20:22.165 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-17T02:20:22.165 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-04-17T02:20:22.165 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-04-17T02:20:22.165 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-04-17T02:20:22.166 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-04-17T02:20:22.166 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-04-17T02:20:22.200 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-04-17T02:20:22.274 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-04-17T02:20:22.334 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 11/36 2024-04-17T02:20:22.372 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 12/36 2024-04-17T02:20:22.431 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ply-3.11-14.el9.noarch 13/36 2024-04-17T02:20:22.496 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 14/36 2024-04-17T02:20:22.685 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 15/36 2024-04-17T02:20:22.734 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 16/36 2024-04-17T02:20:22.779 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 17/36 2024-04-17T02:20:22.832 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 18/36 2024-04-17T02:20:22.863 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 19/36 2024-04-17T02:20:22.942 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 20/36 2024-04-17T02:20:22.973 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-17T02:20:23.006 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 22/36 2024-04-17T02:20:23.047 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 23/36 2024-04-17T02:20:23.082 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/36 2024-04-17T02:20:23.108 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 25/36 2024-04-17T02:20:23.123 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-04-17T02:20:23.123 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:20:23.124 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-04-17T02:20:23.124 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:20:23.124 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mds-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:20:23.124 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:20:23.124 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-modules-core-2:19.0.0-2311.g687eba7a.el9.noarch 2024-04-17T02:20:23.124 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mon-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:20:23.124 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-osd-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:20:23.124 INFO:teuthology.orchestra.run.smithi122.stdout: lua-5.4.4-4.el9.x86_64 2024-04-17T02:20:23.124 INFO:teuthology.orchestra.run.smithi122.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-17T02:20:23.124 INFO:teuthology.orchestra.run.smithi122.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-17T02:20:23.124 INFO:teuthology.orchestra.run.smithi122.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-17T02:20:23.124 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-17T02:20:23.124 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-17T02:20:23.124 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-17T02:20:23.124 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-17T02:20:23.125 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-17T02:20:23.125 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-17T02:20:23.125 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-17T02:20:23.125 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-17T02:20:23.125 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-17T02:20:23.125 INFO:teuthology.orchestra.run.smithi122.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-17T02:20:23.125 INFO:teuthology.orchestra.run.smithi122.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-17T02:20:23.125 INFO:teuthology.orchestra.run.smithi122.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-17T02:20:23.125 INFO:teuthology.orchestra.run.smithi122.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-17T02:20:23.125 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-17T02:20:23.125 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ply-3.11-14.el9.noarch 2024-04-17T02:20:23.125 INFO:teuthology.orchestra.run.smithi122.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-17T02:20:23.125 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-17T02:20:23.125 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-17T02:20:23.126 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-17T02:20:23.126 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-17T02:20:23.126 INFO:teuthology.orchestra.run.smithi122.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-17T02:20:23.126 INFO:teuthology.orchestra.run.smithi122.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-17T02:20:23.126 INFO:teuthology.orchestra.run.smithi122.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-17T02:20:23.126 INFO:teuthology.orchestra.run.smithi122.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-17T02:20:23.126 INFO:teuthology.orchestra.run.smithi122.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-17T02:20:23.126 INFO:teuthology.orchestra.run.smithi122.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-17T02:20:23.126 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:20:23.126 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-04-17T02:20:23.193 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 26/36 2024-04-17T02:20:23.235 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/36 2024-04-17T02:20:23.331 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/36 2024-04-17T02:20:23.471 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 29/36 2024-04-17T02:20:23.535 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-base 2024-04-17T02:20:23.604 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-17T02:20:23.776 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2311.g687eba7a.el9. 31/36 2024-04-17T02:20:23.802 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-2:19.0.0-2311.g687eba7a.el9.x86_64 32/36 2024-04-17T02:20:23.827 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2311.g687eba7a.el9.x86_64 32/36 2024-04-17T02:20:23.828 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-17T02:20:23.828 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-17T02:20:23.828 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-17T02:20:23.828 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-17T02:20:23.828 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:20:24.122 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:00:56 ago on Wed 17 Apr 2024 02:19:28 AM UTC. 2024-04-17T02:20:24.222 INFO:teuthology.orchestra.run.smithi122.stdout:Package ceph-base-2:19.0.0-2311.g687eba7a.el9.x86_64 is already installed. 2024-04-17T02:20:24.274 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-04-17T02:20:24.275 INFO:teuthology.orchestra.run.smithi122.stdout:Nothing to do. 2024-04-17T02:20:24.275 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-04-17T02:20:24.332 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install cephadm 2024-04-17T02:20:24.914 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:00:56 ago on Wed 17 Apr 2024 02:19:28 AM UTC. 2024-04-17T02:20:25.067 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-04-17T02:20:25.067 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-17T02:20:25.067 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-04-17T02:20:25.067 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-17T02:20:25.067 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-04-17T02:20:25.068 INFO:teuthology.orchestra.run.smithi122.stdout: cephadm noarch 2:19.0.0-2311.g687eba7a.el9 ceph-noarch 749 k 2024-04-17T02:20:25.068 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:20:25.068 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-04-17T02:20:25.068 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-17T02:20:25.068 INFO:teuthology.orchestra.run.smithi122.stdout:Install 1 Package 2024-04-17T02:20:25.068 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:20:25.069 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 749 k 2024-04-17T02:20:25.069 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 755 k 2024-04-17T02:20:25.069 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-04-17T02:20:25.345 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-osd-2:19.0.0-2311.g687eba7a.el9.x86_64 33/36 2024-04-17T02:20:25.372 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-osd-2:19.0.0-2311.g687eba7a.el9.x86_64 33/36 2024-04-17T02:20:25.372 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-17T02:20:25.372 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-17T02:20:25.372 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-17T02:20:25.372 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-17T02:20:25.372 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:20:25.704 INFO:teuthology.orchestra.run.smithi122.stdout:cephadm-19.0.0-2311.g687eba7a.el9.noarch.rpm 1.1 MB/s | 749 kB 00:00 2024-04-17T02:20:25.704 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-04-17T02:20:25.705 INFO:teuthology.orchestra.run.smithi122.stdout:Total 1.1 MB/s | 749 kB 00:00 2024-04-17T02:20:25.705 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-04-17T02:20:25.710 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-04-17T02:20:25.710 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-04-17T02:20:25.716 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-04-17T02:20:25.716 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-04-17T02:20:25.793 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-04-17T02:20:25.846 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mon-2:19.0.0-2311.g687eba7a.el9.x86_64 34/36 2024-04-17T02:20:25.869 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mon-2:19.0.0-2311.g687eba7a.el9.x86_64 34/36 2024-04-17T02:20:25.870 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-17T02:20:25.870 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-17T02:20:25.870 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-17T02:20:25.870 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-17T02:20:25.870 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:20:26.105 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mds-2:19.0.0-2311.g687eba7a.el9.x86_64 35/36 2024-04-17T02:20:26.129 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mds-2:19.0.0-2311.g687eba7a.el9.x86_64 35/36 2024-04-17T02:20:26.129 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-17T02:20:26.129 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-17T02:20:26.129 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-17T02:20:26.129 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-17T02:20:26.129 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:20:26.196 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-2:19.0.0-2311.g687eba7a.el9.x86_64 36/36 2024-04-17T02:20:26.222 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: cephadm-2:19.0.0-2311.g687eba7a.el9.noarch 1/1 2024-04-17T02:20:26.301 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : cephadm-2:19.0.0-2311.g687eba7a.el9.noarch 1/1 2024-04-17T02:20:26.680 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: cephadm-2:19.0.0-2311.g687eba7a.el9.noarch 1/1 2024-04-17T02:20:26.955 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : cephadm-2:19.0.0-2311.g687eba7a.el9.noarch 1/1 2024-04-17T02:20:26.955 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:20:26.955 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-04-17T02:20:26.955 INFO:teuthology.orchestra.run.smithi122.stdout: cephadm-2:19.0.0-2311.g687eba7a.el9.noarch 2024-04-17T02:20:26.955 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:20:26.956 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-04-17T02:20:27.180 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-immutable-object-cache 2024-04-17T02:20:27.781 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:00:59 ago on Wed 17 Apr 2024 02:19:28 AM UTC. 2024-04-17T02:20:27.849 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-2:19.0.0-2311.g687eba7a.el9.x86_64 36/36 2024-04-17T02:20:27.849 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-2:19.0.0-2311.g687eba7a.el9.x86_64 1/36 2024-04-17T02:20:27.849 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mds-2:19.0.0-2311.g687eba7a.el9.x86_64 2/36 2024-04-17T02:20:27.849 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-2:19.0.0-2311.g687eba7a.el9.x86_64 3/36 2024-04-17T02:20:27.849 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mon-2:19.0.0-2311.g687eba7a.el9.x86_64 4/36 2024-04-17T02:20:27.849 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-osd-2:19.0.0-2311.g687eba7a.el9.x86_64 5/36 2024-04-17T02:20:27.850 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2311.g687eba7a.el9. 6/36 2024-04-17T02:20:27.850 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lua-5.4.4-4.el9.x86_64 7/36 2024-04-17T02:20:27.850 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 8/36 2024-04-17T02:20:27.850 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 9/36 2024-04-17T02:20:27.850 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 10/36 2024-04-17T02:20:27.850 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 11/36 2024-04-17T02:20:27.850 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 12/36 2024-04-17T02:20:27.850 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 13/36 2024-04-17T02:20:27.850 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ply-3.11-14.el9.noarch 14/36 2024-04-17T02:20:27.850 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 15/36 2024-04-17T02:20:27.850 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 16/36 2024-04-17T02:20:27.850 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 17/36 2024-04-17T02:20:27.850 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-04-17T02:20:27.851 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-04-17T02:20:27.851 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-04-17T02:20:27.851 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-17T02:20:27.851 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-04-17T02:20:27.851 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-04-17T02:20:27.851 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-04-17T02:20:27.851 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-04-17T02:20:27.851 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-04-17T02:20:27.851 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-04-17T02:20:27.852 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-04-17T02:20:27.852 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-04-17T02:20:27.853 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-17T02:20:27.853 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-04-17T02:20:27.853 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-04-17T02:20:27.853 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-04-17T02:20:27.853 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-04-17T02:20:27.853 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-04-17T02:20:27.939 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-04-17T02:20:27.940 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-17T02:20:27.940 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repo Size 2024-04-17T02:20:27.940 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-17T02:20:27.940 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-04-17T02:20:27.940 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 145 k 2024-04-17T02:20:27.940 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:20:27.940 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-04-17T02:20:27.941 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-17T02:20:27.941 INFO:teuthology.orchestra.run.smithi122.stdout:Install 1 Package 2024-04-17T02:20:27.941 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:20:27.941 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 145 k 2024-04-17T02:20:27.941 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 436 k 2024-04-17T02:20:27.941 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-04-17T02:20:28.144 INFO:teuthology.orchestra.run.smithi122.stdout:ceph-immutable-object-cache-19.0.0-2311.g687eba 714 kB/s | 145 kB 00:00 2024-04-17T02:20:28.144 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-04-17T02:20:28.144 INFO:teuthology.orchestra.run.smithi122.stdout:Total 710 kB/s | 145 kB 00:00 2024-04-17T02:20:28.144 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-04-17T02:20:28.152 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-04-17T02:20:28.152 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-04-17T02:20:28.204 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-04-17T02:20:28.205 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-04-17T02:20:28.339 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-04-17T02:20:28.403 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2311.g687eba7a. 1/1 2024-04-17T02:20:28.428 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2311.g687eba7a. 1/1 2024-04-17T02:20:28.428 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-17T02:20:28.428 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-17T02:20:28.428 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:20:28.877 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-04-17T02:20:28.877 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:20:28.877 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-04-17T02:20:28.877 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:20:28.877 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:20:28.877 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:20:28.877 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core-2:19.0.0-2311.g687eba7a.el9.noarch 2024-04-17T02:20:28.877 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:20:28.877 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:20:28.877 INFO:teuthology.orchestra.run.smithi017.stdout: lua-5.4.4-4.el9.x86_64 2024-04-17T02:20:28.877 INFO:teuthology.orchestra.run.smithi017.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-17T02:20:28.877 INFO:teuthology.orchestra.run.smithi017.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-17T02:20:28.878 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-17T02:20:28.878 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-17T02:20:28.878 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-17T02:20:28.878 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-17T02:20:28.878 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-17T02:20:28.878 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-17T02:20:28.878 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-17T02:20:28.878 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-17T02:20:28.878 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-17T02:20:28.878 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-17T02:20:28.878 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-17T02:20:28.878 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-17T02:20:28.878 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-17T02:20:28.878 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-17T02:20:28.879 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-17T02:20:28.879 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ply-3.11-14.el9.noarch 2024-04-17T02:20:28.879 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-17T02:20:28.879 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-17T02:20:28.879 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-17T02:20:28.879 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-17T02:20:28.879 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-17T02:20:28.879 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-17T02:20:28.879 INFO:teuthology.orchestra.run.smithi017.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-17T02:20:28.879 INFO:teuthology.orchestra.run.smithi017.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-17T02:20:28.879 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-17T02:20:28.879 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-17T02:20:28.879 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-17T02:20:28.879 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:20:28.879 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-04-17T02:20:29.204 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-base 2024-04-17T02:20:29.400 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2311.g687eba7a. 1/1 2024-04-17T02:20:29.400 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:20:29.400 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-04-17T02:20:29.400 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-immutable-object-cache-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:20:29.400 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:20:29.400 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-04-17T02:20:29.647 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-mgr 2024-04-17T02:20:29.803 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:09 ago on Wed 17 Apr 2024 02:19:20 AM UTC. 2024-04-17T02:20:29.907 INFO:teuthology.orchestra.run.smithi017.stdout:Package ceph-base-2:19.0.0-2311.g687eba7a.el9.x86_64 is already installed. 2024-04-17T02:20:29.962 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-04-17T02:20:29.964 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-04-17T02:20:29.964 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-04-17T02:20:30.024 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install cephadm 2024-04-17T02:20:30.238 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:01:02 ago on Wed 17 Apr 2024 02:19:28 AM UTC. 2024-04-17T02:20:30.338 INFO:teuthology.orchestra.run.smithi122.stdout:Package ceph-mgr-2:19.0.0-2311.g687eba7a.el9.x86_64 is already installed. 2024-04-17T02:20:30.390 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-04-17T02:20:30.391 INFO:teuthology.orchestra.run.smithi122.stdout:Nothing to do. 2024-04-17T02:20:30.391 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-04-17T02:20:30.448 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-mgr-dashboard 2024-04-17T02:20:30.619 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:10 ago on Wed 17 Apr 2024 02:19:20 AM UTC. 2024-04-17T02:20:30.779 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-04-17T02:20:30.780 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-04-17T02:20:30.780 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-04-17T02:20:30.780 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-04-17T02:20:30.780 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-04-17T02:20:30.780 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm noarch 2:19.0.0-2311.g687eba7a.el9 ceph-noarch 749 k 2024-04-17T02:20:30.780 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:20:30.780 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-04-17T02:20:30.780 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-04-17T02:20:30.780 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2024-04-17T02:20:30.780 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:20:30.781 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 749 k 2024-04-17T02:20:30.781 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 755 k 2024-04-17T02:20:30.781 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-04-17T02:20:31.032 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:01:03 ago on Wed 17 Apr 2024 02:19:28 AM UTC. 2024-04-17T02:20:31.073 INFO:teuthology.orchestra.run.smithi017.stdout:cephadm-19.0.0-2311.g687eba7a.el9.noarch.rpm 2.5 MB/s | 749 kB 00:00 2024-04-17T02:20:31.074 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-04-17T02:20:31.074 INFO:teuthology.orchestra.run.smithi017.stdout:Total 2.5 MB/s | 749 kB 00:00 2024-04-17T02:20:31.074 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-04-17T02:20:31.080 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-04-17T02:20:31.080 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-04-17T02:20:31.086 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-04-17T02:20:31.086 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-04-17T02:20:31.158 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-04-17T02:20:31.185 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-04-17T02:20:31.186 INFO:teuthology.orchestra.run.smithi122.stdout:====================================================================================== 2024-04-17T02:20:31.186 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-04-17T02:20:31.186 INFO:teuthology.orchestra.run.smithi122.stdout:====================================================================================== 2024-04-17T02:20:31.187 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-04-17T02:20:31.187 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2311.g687eba7a.el9 ceph-noarch 3.5 M 2024-04-17T02:20:31.187 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-04-17T02:20:31.187 INFO:teuthology.orchestra.run.smithi122.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-17T02:20:31.187 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2311.g687eba7a.el9 ceph-noarch 32 k 2024-04-17T02:20:31.187 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2311.g687eba7a.el9 ceph-noarch 15 k 2024-04-17T02:20:31.187 INFO:teuthology.orchestra.run.smithi122.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-17T02:20:31.187 INFO:teuthology.orchestra.run.smithi122.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-04-17T02:20:31.187 INFO:teuthology.orchestra.run.smithi122.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-17T02:20:31.187 INFO:teuthology.orchestra.run.smithi122.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-17T02:20:31.187 INFO:teuthology.orchestra.run.smithi122.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-17T02:20:31.187 INFO:teuthology.orchestra.run.smithi122.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-04-17T02:20:31.187 INFO:teuthology.orchestra.run.smithi122.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-17T02:20:31.188 INFO:teuthology.orchestra.run.smithi122.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-17T02:20:31.188 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:20:31.188 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-04-17T02:20:31.188 INFO:teuthology.orchestra.run.smithi122.stdout:====================================================================================== 2024-04-17T02:20:31.188 INFO:teuthology.orchestra.run.smithi122.stdout:Install 12 Packages 2024-04-17T02:20:31.188 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:20:31.188 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 8.6 M 2024-04-17T02:20:31.189 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 103 M 2024-04-17T02:20:31.189 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-04-17T02:20:31.606 INFO:teuthology.orchestra.run.smithi122.stdout:(1/12): ceph-grafana-dashboards-19.0.0-2311.g68 168 kB/s | 32 kB 00:00 2024-04-17T02:20:31.617 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: cephadm-2:19.0.0-2311.g687eba7a.el9.noarch 1/1 2024-04-17T02:20:31.706 INFO:teuthology.orchestra.run.smithi122.stdout:(2/12): ceph-prometheus-alerts-19.0.0-2311.g687 53 kB/s | 15 kB 00:00 2024-04-17T02:20:31.714 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephadm-2:19.0.0-2311.g687eba7a.el9.noarch 1/1 2024-04-17T02:20:31.773 INFO:teuthology.orchestra.run.smithi122.stdout:(3/12): protobuf-3.14.0-13.el9.x86_64.rpm 6.0 MB/s | 1.0 MB 00:00 2024-04-17T02:20:31.798 INFO:teuthology.orchestra.run.smithi122.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 2.5 MB/s | 238 kB 00:00 2024-04-17T02:20:32.024 INFO:teuthology.orchestra.run.smithi122.stdout:(5/12): ceph-mgr-dashboard-19.0.0-2311.g687eba7 5.8 MB/s | 3.5 MB 00:00 2024-04-17T02:20:32.231 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: cephadm-2:19.0.0-2311.g687eba7a.el9.noarch 1/1 2024-04-17T02:20:32.291 INFO:teuthology.orchestra.run.smithi122.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 80 kB/s | 19 kB 00:00 2024-04-17T02:20:32.316 INFO:teuthology.orchestra.run.smithi122.stdout:(7/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 1.0 MB/s | 548 kB 00:00 2024-04-17T02:20:32.391 INFO:teuthology.orchestra.run.smithi122.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 1.9 MB/s | 144 kB 00:00 2024-04-17T02:20:32.467 INFO:teuthology.orchestra.run.smithi122.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 410 kB/s | 31 kB 00:00 2024-04-17T02:20:32.519 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephadm-2:19.0.0-2311.g687eba7a.el9.noarch 1/1 2024-04-17T02:20:32.519 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:20:32.519 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-04-17T02:20:32.519 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm-2:19.0.0-2311.g687eba7a.el9.noarch 2024-04-17T02:20:32.520 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:20:32.520 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-04-17T02:20:32.550 INFO:teuthology.orchestra.run.smithi122.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 2.2 MB/s | 188 kB 00:00 2024-04-17T02:20:32.684 INFO:teuthology.orchestra.run.smithi122.stdout:(11/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 5.2 MB/s | 2.0 MB 00:00 2024-04-17T02:20:32.703 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-immutable-object-cache 2024-04-17T02:20:33.308 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:13 ago on Wed 17 Apr 2024 02:19:20 AM UTC. 2024-04-17T02:20:33.434 INFO:teuthology.orchestra.run.smithi122.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 520 kB/s | 863 kB 00:01 2024-04-17T02:20:33.439 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-04-17T02:20:33.439 INFO:teuthology.orchestra.run.smithi122.stdout:Total 3.8 MB/s | 8.6 MB 00:02 2024-04-17T02:20:33.459 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-04-17T02:20:33.467 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-04-17T02:20:33.468 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-04-17T02:20:33.468 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repo Size 2024-04-17T02:20:33.468 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-04-17T02:20:33.468 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-04-17T02:20:33.468 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 145 k 2024-04-17T02:20:33.468 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:20:33.468 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-04-17T02:20:33.468 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-04-17T02:20:33.468 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2024-04-17T02:20:33.469 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:20:33.469 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 145 k 2024-04-17T02:20:33.469 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 436 k 2024-04-17T02:20:33.469 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-04-17T02:20:33.477 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-04-17T02:20:33.478 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-04-17T02:20:33.671 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-04-17T02:20:33.672 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-04-17T02:20:33.880 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-immutable-object-cache-19.0.0-2311.g687eba 353 kB/s | 145 kB 00:00 2024-04-17T02:20:33.880 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-04-17T02:20:33.881 INFO:teuthology.orchestra.run.smithi017.stdout:Total 352 kB/s | 145 kB 00:00 2024-04-17T02:20:33.881 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-04-17T02:20:33.889 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-04-17T02:20:33.889 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-04-17T02:20:33.945 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-04-17T02:20:33.945 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-04-17T02:20:34.200 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-04-17T02:20:34.208 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-04-17T02:20:34.256 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2311.g687eba7a. 1/1 2024-04-17T02:20:34.282 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2311.g687eba7a. 1/1 2024-04-17T02:20:34.282 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-17T02:20:34.282 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-17T02:20:34.282 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:20:34.293 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-04-17T02:20:34.361 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-04-17T02:20:34.407 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-04-17T02:20:34.430 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-04-17T02:20:34.532 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-04-17T02:20:34.662 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-04-17T02:20:34.749 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-04-17T02:20:34.793 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-04-17T02:20:34.822 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-04-17T02:20:34.863 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2311.g687eba7a.el9 10/12 2024-04-17T02:20:35.270 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2311.g687eba7a. 1/1 2024-04-17T02:20:35.270 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:20:35.270 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-04-17T02:20:35.270 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:20:35.270 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:20:35.270 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-04-17T02:20:35.502 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-mgr 2024-04-17T02:20:35.898 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2311.g687eba7a.el 11/12 2024-04-17T02:20:35.938 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2311.g687eba7a.el9.noa 12/12 2024-04-17T02:20:36.108 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:16 ago on Wed 17 Apr 2024 02:19:20 AM UTC. 2024-04-17T02:20:36.213 INFO:teuthology.orchestra.run.smithi017.stdout:Package ceph-mgr-2:19.0.0-2311.g687eba7a.el9.x86_64 is already installed. 2024-04-17T02:20:36.268 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-04-17T02:20:36.270 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-04-17T02:20:36.270 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-04-17T02:20:36.335 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-mgr-dashboard 2024-04-17T02:20:36.932 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:16 ago on Wed 17 Apr 2024 02:19:20 AM UTC. 2024-04-17T02:20:37.093 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-04-17T02:20:37.094 INFO:teuthology.orchestra.run.smithi017.stdout:====================================================================================== 2024-04-17T02:20:37.094 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-04-17T02:20:37.094 INFO:teuthology.orchestra.run.smithi017.stdout:====================================================================================== 2024-04-17T02:20:37.094 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-04-17T02:20:37.094 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2311.g687eba7a.el9 ceph-noarch 3.5 M 2024-04-17T02:20:37.094 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-04-17T02:20:37.094 INFO:teuthology.orchestra.run.smithi017.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-17T02:20:37.095 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2311.g687eba7a.el9 ceph-noarch 32 k 2024-04-17T02:20:37.095 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2311.g687eba7a.el9 ceph-noarch 15 k 2024-04-17T02:20:37.095 INFO:teuthology.orchestra.run.smithi017.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-17T02:20:37.095 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-04-17T02:20:37.095 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-17T02:20:37.095 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-17T02:20:37.095 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-17T02:20:37.095 INFO:teuthology.orchestra.run.smithi017.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-04-17T02:20:37.095 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-17T02:20:37.095 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-17T02:20:37.095 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:20:37.095 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-04-17T02:20:37.095 INFO:teuthology.orchestra.run.smithi017.stdout:====================================================================================== 2024-04-17T02:20:37.095 INFO:teuthology.orchestra.run.smithi017.stdout:Install 12 Packages 2024-04-17T02:20:37.096 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:20:37.096 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 8.6 M 2024-04-17T02:20:37.096 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 103 M 2024-04-17T02:20:37.096 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-04-17T02:20:37.384 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2311.g687eba7a.el9.noa 12/12 2024-04-17T02:20:37.384 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2311.g687eba7a.el 1/12 2024-04-17T02:20:37.384 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2311.g687eba7a.el9.noa 2/12 2024-04-17T02:20:37.384 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2311.g687eba7a.el9 3/12 2024-04-17T02:20:37.384 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-04-17T02:20:37.384 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-04-17T02:20:37.384 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-04-17T02:20:37.385 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-04-17T02:20:37.385 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-04-17T02:20:37.385 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-04-17T02:20:37.385 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-04-17T02:20:37.385 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-04-17T02:20:37.726 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-04-17T02:20:37.727 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:20:37.727 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-04-17T02:20:37.727 INFO:teuthology.orchestra.run.smithi122.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-17T02:20:37.727 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-grafana-dashboards-2:19.0.0-2311.g687eba7a.el9.noarch 2024-04-17T02:20:37.727 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-dashboard-2:19.0.0-2311.g687eba7a.el9.noarch 2024-04-17T02:20:37.727 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-prometheus-alerts-2:19.0.0-2311.g687eba7a.el9.noarch 2024-04-17T02:20:37.727 INFO:teuthology.orchestra.run.smithi122.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-17T02:20:37.727 INFO:teuthology.orchestra.run.smithi122.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-17T02:20:37.727 INFO:teuthology.orchestra.run.smithi122.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-17T02:20:37.727 INFO:teuthology.orchestra.run.smithi122.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-17T02:20:37.727 INFO:teuthology.orchestra.run.smithi122.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-17T02:20:37.727 INFO:teuthology.orchestra.run.smithi122.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-17T02:20:37.728 INFO:teuthology.orchestra.run.smithi122.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-17T02:20:37.728 INFO:teuthology.orchestra.run.smithi122.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-17T02:20:37.728 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:20:37.728 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-04-17T02:20:37.951 INFO:teuthology.orchestra.run.smithi017.stdout:(1/12): ceph-grafana-dashboards-19.0.0-2311.g68 143 kB/s | 32 kB 00:00 2024-04-17T02:20:37.988 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-17T02:20:38.085 INFO:teuthology.orchestra.run.smithi017.stdout:(2/12): ceph-prometheus-alerts-19.0.0-2311.g687 43 kB/s | 15 kB 00:00 2024-04-17T02:20:38.135 INFO:teuthology.orchestra.run.smithi017.stdout:(3/12): protobuf-3.14.0-13.el9.x86_64.rpm 5.5 MB/s | 1.0 MB 00:00 2024-04-17T02:20:38.160 INFO:teuthology.orchestra.run.smithi017.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 3.1 MB/s | 238 kB 00:00 2024-04-17T02:20:38.386 INFO:teuthology.orchestra.run.smithi017.stdout:(5/12): protobuf-compiler-3.14.0-13.el9.x86_64. 3.4 MB/s | 863 kB 00:00 2024-04-17T02:20:38.419 INFO:teuthology.orchestra.run.smithi017.stdout:(6/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 2.1 MB/s | 548 kB 00:00 2024-04-17T02:20:38.444 INFO:teuthology.orchestra.run.smithi017.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 334 kB/s | 19 kB 00:00 2024-04-17T02:20:38.520 INFO:teuthology.orchestra.run.smithi017.stdout:(8/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 20 MB/s | 2.0 MB 00:00 2024-04-17T02:20:38.545 INFO:teuthology.orchestra.run.smithi017.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 1.4 MB/s | 144 kB 00:00 2024-04-17T02:20:38.570 INFO:teuthology.orchestra.run.smithi017.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 615 kB/s | 31 kB 00:00 2024-04-17T02:20:38.574 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:01:10 ago on Wed 17 Apr 2024 02:19:28 AM UTC. 2024-04-17T02:20:38.595 INFO:teuthology.orchestra.run.smithi017.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-04-17T02:20:38.731 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-04-17T02:20:38.732 INFO:teuthology.orchestra.run.smithi122.stdout:============================================================================================ 2024-04-17T02:20:38.733 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-04-17T02:20:38.733 INFO:teuthology.orchestra.run.smithi122.stdout:============================================================================================ 2024-04-17T02:20:38.733 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-04-17T02:20:38.733 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2311.g687eba7a.el9 ceph-noarch 7.4 M 2024-04-17T02:20:38.733 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-04-17T02:20:38.733 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-17T02:20:38.733 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-17T02:20:38.733 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-17T02:20:38.733 INFO:teuthology.orchestra.run.smithi122.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-17T02:20:38.733 INFO:teuthology.orchestra.run.smithi122.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-17T02:20:38.733 INFO:teuthology.orchestra.run.smithi122.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-17T02:20:38.733 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-17T02:20:38.734 INFO:teuthology.orchestra.run.smithi122.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-17T02:20:38.734 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-17T02:20:38.734 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-17T02:20:38.734 INFO:teuthology.orchestra.run.smithi122.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-17T02:20:38.734 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:20:38.734 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-04-17T02:20:38.734 INFO:teuthology.orchestra.run.smithi122.stdout:============================================================================================ 2024-04-17T02:20:38.734 INFO:teuthology.orchestra.run.smithi122.stdout:Install 12 Packages 2024-04-17T02:20:38.734 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:20:38.735 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 37 M 2024-04-17T02:20:38.735 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 209 M 2024-04-17T02:20:38.735 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-04-17T02:20:39.046 INFO:teuthology.orchestra.run.smithi017.stdout:(12/12): ceph-mgr-dashboard-19.0.0-2311.g687eba 2.7 MB/s | 3.5 MB 00:01 2024-04-17T02:20:39.049 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-04-17T02:20:39.050 INFO:teuthology.orchestra.run.smithi017.stdout:Total 4.4 MB/s | 8.6 MB 00:01 2024-04-17T02:20:39.069 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-04-17T02:20:39.087 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-04-17T02:20:39.087 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-04-17T02:20:39.279 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-04-17T02:20:39.279 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-04-17T02:20:39.292 INFO:teuthology.orchestra.run.smithi122.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 221 kB/s | 32 kB 00:00 2024-04-17T02:20:39.326 INFO:teuthology.orchestra.run.smithi122.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 531 kB/s | 17 kB 00:00 2024-04-17T02:20:39.384 INFO:teuthology.orchestra.run.smithi122.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 592 kB/s | 34 kB 00:00 2024-04-17T02:20:39.460 INFO:teuthology.orchestra.run.smithi122.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 9.6 MB/s | 3.0 MB 00:00 2024-04-17T02:20:39.785 INFO:teuthology.orchestra.run.smithi122.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 12 MB/s | 4.7 MB 00:00 2024-04-17T02:20:39.807 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-04-17T02:20:39.852 INFO:teuthology.orchestra.run.smithi122.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 4.8 MB 00:00 2024-04-17T02:20:39.877 INFO:teuthology.orchestra.run.smithi122.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.4 MB/s | 217 kB 00:00 2024-04-17T02:20:39.881 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-04-17T02:20:39.924 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-04-17T02:20:39.971 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-04-17T02:20:40.171 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-04-17T02:20:40.171 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-04-17T02:20:40.231 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-04-17T02:20:40.269 INFO:teuthology.orchestra.run.smithi122.stdout:(8/12): ceph-mgr-diskprediction-local-19.0.0-23 6.6 MB/s | 7.4 MB 00:01 2024-04-17T02:20:40.332 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-04-17T02:20:40.381 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-04-17T02:20:40.408 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-04-17T02:20:40.441 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2311.g687eba7a.el9 10/12 2024-04-17T02:20:40.445 INFO:teuthology.orchestra.run.smithi122.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-04-17T02:20:40.470 INFO:teuthology.orchestra.run.smithi122.stdout:(10/12): libgfortran-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 803 kB 00:00 2024-04-17T02:20:40.595 INFO:teuthology.orchestra.run.smithi122.stdout:(11/12): libquadmath-11.4.1-3.el9.x86_64.rpm 604 kB/s | 195 kB 00:00 2024-04-17T02:20:40.636 INFO:teuthology.orchestra.run.smithi122.stdout:(12/12): python3-devel-3.9.17-2.el9.x86_64.rpm 1.2 MB/s | 245 kB 00:00 2024-04-17T02:20:40.638 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-04-17T02:20:40.639 INFO:teuthology.orchestra.run.smithi122.stdout:Total 19 MB/s | 37 MB 00:01 2024-04-17T02:20:40.680 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-04-17T02:20:40.704 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-04-17T02:20:40.704 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-04-17T02:20:41.060 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-04-17T02:20:41.060 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-04-17T02:20:41.537 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2311.g687eba7a.el 11/12 2024-04-17T02:20:41.566 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2311.g687eba7a.el9.noa 12/12 2024-04-17T02:20:41.786 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-04-17T02:20:41.859 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-04-17T02:20:41.891 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-17T02:20:41.983 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-04-17T02:20:42.019 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-04-17T02:20:42.197 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-17T02:20:42.235 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-17T02:20:42.312 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-17T02:20:42.818 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2311.g687eba7a.el9.noa 12/12 2024-04-17T02:20:42.819 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2311.g687eba7a.el 1/12 2024-04-17T02:20:42.819 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2311.g687eba7a.el9.noa 2/12 2024-04-17T02:20:42.819 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2311.g687eba7a.el9 3/12 2024-04-17T02:20:42.819 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-04-17T02:20:42.819 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-04-17T02:20:42.819 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-04-17T02:20:42.819 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-04-17T02:20:42.819 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-04-17T02:20:42.819 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-04-17T02:20:42.819 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-04-17T02:20:42.819 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-04-17T02:20:42.970 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-17T02:20:43.080 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-17T02:20:43.163 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-04-17T02:20:43.163 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:20:43.163 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-04-17T02:20:43.163 INFO:teuthology.orchestra.run.smithi017.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-17T02:20:43.163 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards-2:19.0.0-2311.g687eba7a.el9.noarch 2024-04-17T02:20:43.163 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard-2:19.0.0-2311.g687eba7a.el9.noarch 2024-04-17T02:20:43.163 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts-2:19.0.0-2311.g687eba7a.el9.noarch 2024-04-17T02:20:43.164 INFO:teuthology.orchestra.run.smithi017.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-17T02:20:43.164 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-17T02:20:43.164 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-17T02:20:43.164 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-17T02:20:43.164 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-17T02:20:43.164 INFO:teuthology.orchestra.run.smithi017.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-17T02:20:43.164 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-17T02:20:43.164 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-17T02:20:43.164 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:20:43.164 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-04-17T02:20:43.445 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-17T02:20:44.046 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:24 ago on Wed 17 Apr 2024 02:19:20 AM UTC. 2024-04-17T02:20:44.210 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-04-17T02:20:44.211 INFO:teuthology.orchestra.run.smithi017.stdout:============================================================================================ 2024-04-17T02:20:44.211 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-04-17T02:20:44.211 INFO:teuthology.orchestra.run.smithi017.stdout:============================================================================================ 2024-04-17T02:20:44.211 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-04-17T02:20:44.211 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2311.g687eba7a.el9 ceph-noarch 7.4 M 2024-04-17T02:20:44.211 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-04-17T02:20:44.211 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-17T02:20:44.211 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-17T02:20:44.211 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-17T02:20:44.211 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-17T02:20:44.211 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-17T02:20:44.212 INFO:teuthology.orchestra.run.smithi017.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-17T02:20:44.212 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-17T02:20:44.212 INFO:teuthology.orchestra.run.smithi017.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-17T02:20:44.212 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-17T02:20:44.212 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-17T02:20:44.212 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-17T02:20:44.212 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:20:44.212 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-04-17T02:20:44.212 INFO:teuthology.orchestra.run.smithi017.stdout:============================================================================================ 2024-04-17T02:20:44.212 INFO:teuthology.orchestra.run.smithi017.stdout:Install 12 Packages 2024-04-17T02:20:44.212 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:20:44.213 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 37 M 2024-04-17T02:20:44.213 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 209 M 2024-04-17T02:20:44.213 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-04-17T02:20:44.303 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-17T02:20:44.697 INFO:teuthology.orchestra.run.smithi017.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 186 kB/s | 32 kB 00:00 2024-04-17T02:20:44.739 INFO:teuthology.orchestra.run.smithi017.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 412 kB/s | 17 kB 00:00 2024-04-17T02:20:44.789 INFO:teuthology.orchestra.run.smithi017.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 697 kB/s | 34 kB 00:00 2024-04-17T02:20:44.848 INFO:teuthology.orchestra.run.smithi017.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 9.3 MB/s | 3.0 MB 00:00 2024-04-17T02:20:45.123 INFO:teuthology.orchestra.run.smithi017.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 14 MB/s | 4.7 MB 00:00 2024-04-17T02:20:45.182 INFO:teuthology.orchestra.run.smithi017.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 4.8 MB 00:00 2024-04-17T02:20:45.207 INFO:teuthology.orchestra.run.smithi017.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.6 MB/s | 217 kB 00:00 2024-04-17T02:20:45.330 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-17T02:20:45.377 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2311.g687eb 12/12 2024-04-17T02:20:45.574 INFO:teuthology.orchestra.run.smithi017.stdout:(8/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 40 MB/s | 16 MB 00:00 2024-04-17T02:20:45.782 INFO:teuthology.orchestra.run.smithi017.stdout:(9/12): ceph-mgr-diskprediction-local-19.0.0-23 5.9 MB/s | 7.4 MB 00:01 2024-04-17T02:20:45.916 INFO:teuthology.orchestra.run.smithi017.stdout:(10/12): python3-devel-3.9.17-2.el9.x86_64.rpm 1.8 MB/s | 245 kB 00:00 2024-04-17T02:20:46.508 INFO:teuthology.orchestra.run.smithi017.stdout:(11/12): libquadmath-11.4.1-3.el9.x86_64.rpm 209 kB/s | 195 kB 00:00 2024-04-17T02:20:47.075 INFO:teuthology.orchestra.run.smithi017.stdout:(12/12): libgfortran-11.4.1-3.el9.x86_64.rpm 430 kB/s | 803 kB 00:01 2024-04-17T02:20:47.078 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-04-17T02:20:47.079 INFO:teuthology.orchestra.run.smithi017.stdout:Total 13 MB/s | 37 MB 00:02 2024-04-17T02:20:47.124 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-04-17T02:20:47.151 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-04-17T02:20:47.151 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-04-17T02:20:47.529 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-04-17T02:20:47.529 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-04-17T02:20:47.988 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2311.g687eb 12/12 2024-04-17T02:20:47.988 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2311.g687eb 1/12 2024-04-17T02:20:47.988 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-04-17T02:20:47.988 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-04-17T02:20:47.988 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-04-17T02:20:47.988 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-17T02:20:47.988 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-17T02:20:47.988 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-04-17T02:20:47.988 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-04-17T02:20:47.988 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-04-17T02:20:47.989 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-04-17T02:20:47.989 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-04-17T02:20:48.258 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-04-17T02:20:48.335 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-04-17T02:20:48.363 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-17T02:20:48.392 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-04-17T02:20:48.392 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:20:48.392 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-04-17T02:20:48.392 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2311.g687eba7a.el9.noarch 2024-04-17T02:20:48.392 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-17T02:20:48.392 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-17T02:20:48.392 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-17T02:20:48.392 INFO:teuthology.orchestra.run.smithi122.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-17T02:20:48.392 INFO:teuthology.orchestra.run.smithi122.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-17T02:20:48.392 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-17T02:20:48.393 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-17T02:20:48.393 INFO:teuthology.orchestra.run.smithi122.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-17T02:20:48.393 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-17T02:20:48.393 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-17T02:20:48.393 INFO:teuthology.orchestra.run.smithi122.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-17T02:20:48.393 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:20:48.393 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-04-17T02:20:48.462 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-04-17T02:20:48.500 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-04-17T02:20:48.683 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-17T02:20:48.715 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-17T02:20:48.772 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-mgr-rook 2024-04-17T02:20:48.796 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-17T02:20:49.370 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:01:21 ago on Wed 17 Apr 2024 02:19:28 AM UTC. 2024-04-17T02:20:49.500 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-17T02:20:49.526 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-04-17T02:20:49.527 INFO:teuthology.orchestra.run.smithi122.stdout:======================================================================================== 2024-04-17T02:20:49.527 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-04-17T02:20:49.527 INFO:teuthology.orchestra.run.smithi122.stdout:======================================================================================== 2024-04-17T02:20:49.527 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-04-17T02:20:49.527 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-rook noarch 2:19.0.0-2311.g687eba7a.el9 ceph-noarch 49 k 2024-04-17T02:20:49.528 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-04-17T02:20:49.528 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-17T02:20:49.528 INFO:teuthology.orchestra.run.smithi122.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-17T02:20:49.528 INFO:teuthology.orchestra.run.smithi122.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-17T02:20:49.528 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-17T02:20:49.528 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-17T02:20:49.528 INFO:teuthology.orchestra.run.smithi122.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-17T02:20:49.528 INFO:teuthology.orchestra.run.smithi122.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-17T02:20:49.528 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-17T02:20:49.528 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-17T02:20:49.528 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-17T02:20:49.528 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-17T02:20:49.528 INFO:teuthology.orchestra.run.smithi122.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-17T02:20:49.528 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:20:49.529 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-04-17T02:20:49.529 INFO:teuthology.orchestra.run.smithi122.stdout:======================================================================================== 2024-04-17T02:20:49.529 INFO:teuthology.orchestra.run.smithi122.stdout:Install 13 Packages 2024-04-17T02:20:49.529 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:20:49.529 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 2.0 M 2024-04-17T02:20:49.529 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 26 M 2024-04-17T02:20:49.530 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-04-17T02:20:49.614 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-17T02:20:49.811 INFO:teuthology.orchestra.run.smithi122.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 197 kB/s | 24 kB 00:00 2024-04-17T02:20:49.836 INFO:teuthology.orchestra.run.smithi122.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 121 kB/s | 18 kB 00:00 2024-04-17T02:20:49.886 INFO:teuthology.orchestra.run.smithi122.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.3 MB/s | 174 kB 00:00 2024-04-17T02:20:49.912 INFO:teuthology.orchestra.run.smithi122.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-04-17T02:20:49.946 INFO:teuthology.orchestra.run.smithi122.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 3.5 MB/s | 211 kB 00:00 2024-04-17T02:20:49.971 INFO:teuthology.orchestra.run.smithi122.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 733 kB/s | 43 kB 00:00 2024-04-17T02:20:49.996 INFO:teuthology.orchestra.run.smithi122.stdout:(7/13): ceph-mgr-rook-19.0.0-2311.g687eba7a.el9 160 kB/s | 49 kB 00:00 2024-04-17T02:20:50.065 INFO:teuthology.orchestra.run.smithi122.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 163 kB/s | 15 kB 00:00 2024-04-17T02:20:50.088 INFO:teuthology.orchestra.run.smithi122.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 226 kB/s | 32 kB 00:00 2024-04-17T02:20:50.147 INFO:teuthology.orchestra.run.smithi122.stdout:(10/13): python3-google-auth-2.28.2-1.el9.noarc 1.3 MB/s | 203 kB 00:00 2024-04-17T02:20:50.172 INFO:teuthology.orchestra.run.smithi122.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 705 kB/s | 59 kB 00:00 2024-04-17T02:20:50.222 INFO:teuthology.orchestra.run.smithi122.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.2 MB/s | 90 kB 00:00 2024-04-17T02:20:50.381 INFO:teuthology.orchestra.run.smithi122.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 3.2 MB/s | 1.0 MB 00:00 2024-04-17T02:20:50.382 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-04-17T02:20:50.383 INFO:teuthology.orchestra.run.smithi122.stdout:Total 2.4 MB/s | 2.0 MB 00:00 2024-04-17T02:20:50.383 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-04-17T02:20:50.396 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-04-17T02:20:50.396 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-04-17T02:20:50.486 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-04-17T02:20:50.486 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-04-17T02:20:50.920 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-17T02:20:51.009 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-04-17T02:20:51.185 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-17T02:20:51.240 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-17T02:20:51.295 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-17T02:20:51.325 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-17T02:20:51.374 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-17T02:20:51.475 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-17T02:20:51.584 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-04-17T02:20:51.634 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-17T02:20:51.989 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-17T02:20:52.014 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2311.g687eb 12/12 2024-04-17T02:20:52.353 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-17T02:20:52.399 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-17T02:20:52.441 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-17T02:20:52.489 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-17T02:20:52.511 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-rook-2:19.0.0-2311.g687eba7a.el9.noarch 13/13 2024-04-17T02:20:53.320 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2311.g687eba7a.el9.noarch 13/13 2024-04-17T02:20:53.320 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2311.g687eba7a.el9.noarch 1/13 2024-04-17T02:20:53.321 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-17T02:20:53.321 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-17T02:20:53.321 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-17T02:20:53.321 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-17T02:20:53.321 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-17T02:20:53.321 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-17T02:20:53.321 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-17T02:20:53.321 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-17T02:20:53.321 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-04-17T02:20:53.321 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-17T02:20:53.321 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-17T02:20:53.718 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-17T02:20:53.718 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:20:53.718 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-04-17T02:20:53.718 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-rook-2:19.0.0-2311.g687eba7a.el9.noarch 2024-04-17T02:20:53.718 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-17T02:20:53.718 INFO:teuthology.orchestra.run.smithi122.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-17T02:20:53.718 INFO:teuthology.orchestra.run.smithi122.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-17T02:20:53.719 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-17T02:20:53.719 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-17T02:20:53.719 INFO:teuthology.orchestra.run.smithi122.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-17T02:20:53.719 INFO:teuthology.orchestra.run.smithi122.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-17T02:20:53.719 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-17T02:20:53.719 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-17T02:20:53.719 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-17T02:20:53.719 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-17T02:20:53.719 INFO:teuthology.orchestra.run.smithi122.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-17T02:20:53.719 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:20:53.719 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-04-17T02:20:54.057 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-mgr-cephadm 2024-04-17T02:20:54.435 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2311.g687eb 12/12 2024-04-17T02:20:54.435 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2311.g687eb 1/12 2024-04-17T02:20:54.435 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-04-17T02:20:54.436 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-04-17T02:20:54.436 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-04-17T02:20:54.436 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-17T02:20:54.436 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-17T02:20:54.436 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-04-17T02:20:54.436 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-04-17T02:20:54.436 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-04-17T02:20:54.436 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-04-17T02:20:54.436 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-04-17T02:20:54.647 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:01:26 ago on Wed 17 Apr 2024 02:19:28 AM UTC. 2024-04-17T02:20:54.801 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-04-17T02:20:54.802 INFO:teuthology.orchestra.run.smithi122.stdout:======================================================================================== 2024-04-17T02:20:54.802 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-04-17T02:20:54.802 INFO:teuthology.orchestra.run.smithi122.stdout:======================================================================================== 2024-04-17T02:20:54.802 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-04-17T02:20:54.802 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2311.g687eba7a.el9 ceph-noarch 139 k 2024-04-17T02:20:54.802 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-04-17T02:20:54.802 INFO:teuthology.orchestra.run.smithi122.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-17T02:20:54.802 INFO:teuthology.orchestra.run.smithi122.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-17T02:20:54.802 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-17T02:20:54.802 INFO:teuthology.orchestra.run.smithi122.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-17T02:20:54.802 INFO:teuthology.orchestra.run.smithi122.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-17T02:20:54.803 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:20:54.803 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-04-17T02:20:54.803 INFO:teuthology.orchestra.run.smithi122.stdout:======================================================================================== 2024-04-17T02:20:54.803 INFO:teuthology.orchestra.run.smithi122.stdout:Install 6 Packages 2024-04-17T02:20:54.803 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:20:54.803 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 6.8 M 2024-04-17T02:20:54.803 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 33 M 2024-04-17T02:20:54.803 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-04-17T02:20:54.836 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-04-17T02:20:54.836 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:20:54.836 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-04-17T02:20:54.836 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2311.g687eba7a.el9.noarch 2024-04-17T02:20:54.836 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-17T02:20:54.836 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-17T02:20:54.836 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-17T02:20:54.836 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-17T02:20:54.836 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-17T02:20:54.836 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-17T02:20:54.836 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-17T02:20:54.836 INFO:teuthology.orchestra.run.smithi017.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-17T02:20:54.837 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-17T02:20:54.837 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-17T02:20:54.837 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-17T02:20:54.837 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:20:54.837 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-04-17T02:20:55.204 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-mgr-rook 2024-04-17T02:20:55.208 INFO:teuthology.orchestra.run.smithi122.stdout:(1/6): python3-babel-2.9.1-2.el9.noarch.rpm 23 MB/s | 5.8 MB 00:00 2024-04-17T02:20:55.342 INFO:teuthology.orchestra.run.smithi122.stdout:(2/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 642 kB/s | 248 kB 00:00 2024-04-17T02:20:55.659 INFO:teuthology.orchestra.run.smithi122.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 182 kB/s | 58 kB 00:00 2024-04-17T02:20:55.684 INFO:teuthology.orchestra.run.smithi122.stdout:(4/6): ceph-mgr-cephadm-19.0.0-2311.g687eba7a.e 191 kB/s | 139 kB 00:00 2024-04-17T02:20:55.710 INFO:teuthology.orchestra.run.smithi122.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.1 MB/s | 548 kB 00:00 2024-04-17T02:20:55.760 INFO:teuthology.orchestra.run.smithi122.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 509 kB/s | 51 kB 00:00 2024-04-17T02:20:55.760 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-04-17T02:20:55.761 INFO:teuthology.orchestra.run.smithi122.stdout:Total 7.1 MB/s | 6.8 MB 00:00 2024-04-17T02:20:55.775 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-04-17T02:20:55.785 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-04-17T02:20:55.785 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-04-17T02:20:55.812 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:35 ago on Wed 17 Apr 2024 02:19:20 AM UTC. 2024-04-17T02:20:55.874 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-04-17T02:20:55.876 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-04-17T02:20:55.977 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-04-17T02:20:55.978 INFO:teuthology.orchestra.run.smithi017.stdout:======================================================================================== 2024-04-17T02:20:55.978 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-04-17T02:20:55.978 INFO:teuthology.orchestra.run.smithi017.stdout:======================================================================================== 2024-04-17T02:20:55.978 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-04-17T02:20:55.978 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook noarch 2:19.0.0-2311.g687eba7a.el9 ceph-noarch 49 k 2024-04-17T02:20:55.978 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-04-17T02:20:55.978 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-17T02:20:55.978 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-17T02:20:55.978 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-17T02:20:55.978 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-17T02:20:55.979 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-17T02:20:55.979 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-17T02:20:55.979 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-17T02:20:55.979 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-17T02:20:55.979 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-17T02:20:55.979 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-17T02:20:55.979 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-17T02:20:55.979 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-17T02:20:55.979 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:20:55.979 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-04-17T02:20:55.979 INFO:teuthology.orchestra.run.smithi017.stdout:======================================================================================== 2024-04-17T02:20:55.979 INFO:teuthology.orchestra.run.smithi017.stdout:Install 13 Packages 2024-04-17T02:20:55.979 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:20:55.980 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 2.0 M 2024-04-17T02:20:55.980 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 26 M 2024-04-17T02:20:55.980 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-04-17T02:20:56.172 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-04-17T02:20:56.342 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-17T02:20:56.394 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-17T02:20:56.465 INFO:teuthology.orchestra.run.smithi017.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 145 kB/s | 18 kB 00:00 2024-04-17T02:20:56.490 INFO:teuthology.orchestra.run.smithi017.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 163 kB/s | 24 kB 00:00 2024-04-17T02:20:56.549 INFO:teuthology.orchestra.run.smithi017.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 174 kB 00:00 2024-04-17T02:20:56.574 INFO:teuthology.orchestra.run.smithi017.stdout:(4/13): ceph-mgr-rook-19.0.0-2311.g687eba7a.el9 211 kB/s | 49 kB 00:00 2024-04-17T02:20:56.608 INFO:teuthology.orchestra.run.smithi017.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 132 kB 00:00 2024-04-17T02:20:56.633 INFO:teuthology.orchestra.run.smithi017.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.5 MB/s | 211 kB 00:00 2024-04-17T02:20:56.658 INFO:teuthology.orchestra.run.smithi017.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 511 kB/s | 43 kB 00:00 2024-04-17T02:20:56.922 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-17T02:20:56.934 INFO:teuthology.orchestra.run.smithi017.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 107 kB/s | 32 kB 00:00 2024-04-17T02:20:56.959 INFO:teuthology.orchestra.run.smithi017.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 46 kB/s | 15 kB 00:00 2024-04-17T02:20:57.005 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-17T02:20:57.067 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-17T02:20:57.092 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2311.g687eba7a.el9.noarch 6/6 2024-04-17T02:20:57.109 INFO:teuthology.orchestra.run.smithi017.stdout:(10/13): python3-google-auth-2.28.2-1.el9.noarc 450 kB/s | 203 kB 00:00 2024-04-17T02:20:57.134 INFO:teuthology.orchestra.run.smithi017.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 337 kB/s | 59 kB 00:00 2024-04-17T02:20:57.226 INFO:teuthology.orchestra.run.smithi017.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 767 kB/s | 90 kB 00:00 2024-04-17T02:20:57.260 INFO:teuthology.orchestra.run.smithi017.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 3.1 MB/s | 1.0 MB 00:00 2024-04-17T02:20:57.264 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-04-17T02:20:57.264 INFO:teuthology.orchestra.run.smithi017.stdout:Total 1.6 MB/s | 2.0 MB 00:01 2024-04-17T02:20:57.264 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-04-17T02:20:57.279 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-04-17T02:20:57.279 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-04-17T02:20:57.381 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-04-17T02:20:57.381 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-04-17T02:20:57.911 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-04-17T02:20:57.924 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2311.g687eba7a.el9.noarch 6/6 2024-04-17T02:20:57.925 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2311.g687eba7a.el9.noarch 1/6 2024-04-17T02:20:57.925 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-17T02:20:57.925 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-17T02:20:57.925 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-17T02:20:57.925 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-17T02:20:58.080 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-17T02:20:58.148 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-17T02:20:58.210 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-17T02:20:58.215 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-17T02:20:58.215 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:20:58.215 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-04-17T02:20:58.215 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-cephadm-2:19.0.0-2311.g687eba7a.el9.noarch 2024-04-17T02:20:58.215 INFO:teuthology.orchestra.run.smithi122.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-17T02:20:58.216 INFO:teuthology.orchestra.run.smithi122.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-17T02:20:58.216 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-17T02:20:58.216 INFO:teuthology.orchestra.run.smithi122.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-17T02:20:58.216 INFO:teuthology.orchestra.run.smithi122.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-17T02:20:58.216 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:20:58.216 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-04-17T02:20:58.246 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-17T02:20:58.288 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-17T02:20:58.384 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-17T02:20:58.484 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-fuse 2024-04-17T02:20:58.502 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-04-17T02:20:58.556 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-17T02:20:59.079 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:01:31 ago on Wed 17 Apr 2024 02:19:28 AM UTC. 2024-04-17T02:20:59.235 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-04-17T02:20:59.236 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-17T02:20:59.236 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-04-17T02:20:59.236 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-17T02:20:59.236 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-04-17T02:20:59.236 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-fuse x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 889 k 2024-04-17T02:20:59.236 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-04-17T02:20:59.236 INFO:teuthology.orchestra.run.smithi122.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-17T02:20:59.236 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:20:59.236 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-04-17T02:20:59.236 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-17T02:20:59.236 INFO:teuthology.orchestra.run.smithi122.stdout:Install 2 Packages 2024-04-17T02:20:59.236 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:20:59.237 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 968 k 2024-04-17T02:20:59.237 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 2.8 M 2024-04-17T02:20:59.237 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-04-17T02:20:59.314 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-17T02:20:59.361 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-17T02:20:59.363 INFO:teuthology.orchestra.run.smithi122.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 625 kB/s | 79 kB 00:00 2024-04-17T02:20:59.395 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-17T02:20:59.444 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-17T02:20:59.464 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-rook-2:19.0.0-2311.g687eba7a.el9.noarch 13/13 2024-04-17T02:21:00.247 INFO:teuthology.orchestra.run.smithi122.stdout:(2/2): ceph-fuse-19.0.0-2311.g687eba7a.el9.x86_ 881 kB/s | 889 kB 00:01 2024-04-17T02:21:00.248 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-04-17T02:21:00.248 INFO:teuthology.orchestra.run.smithi122.stdout:Total 957 kB/s | 968 kB 00:01 2024-04-17T02:21:00.248 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-04-17T02:21:00.272 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-04-17T02:21:00.272 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-04-17T02:21:00.284 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2311.g687eba7a.el9.noarch 13/13 2024-04-17T02:21:00.284 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2311.g687eba7a.el9.noarch 1/13 2024-04-17T02:21:00.284 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-17T02:21:00.284 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-17T02:21:00.284 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-17T02:21:00.284 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-17T02:21:00.285 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-17T02:21:00.285 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-17T02:21:00.285 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-17T02:21:00.285 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-17T02:21:00.285 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-04-17T02:21:00.285 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-17T02:21:00.285 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-17T02:21:00.347 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-04-17T02:21:00.347 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-04-17T02:21:00.538 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-04-17T02:21:00.628 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-17T02:21:00.628 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:00.628 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-04-17T02:21:00.628 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook-2:19.0.0-2311.g687eba7a.el9.noarch 2024-04-17T02:21:00.628 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-17T02:21:00.628 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-17T02:21:00.628 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-17T02:21:00.628 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-17T02:21:00.628 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-17T02:21:00.628 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-17T02:21:00.628 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-17T02:21:00.629 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-17T02:21:00.629 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-17T02:21:00.629 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-17T02:21:00.629 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-17T02:21:00.629 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-17T02:21:00.629 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:00.629 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-04-17T02:21:00.681 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-17T02:21:00.755 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-fuse-2:19.0.0-2311.g687eba7a.el9.x86_64 2/2 2024-04-17T02:21:00.885 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-mgr-cephadm 2024-04-17T02:21:01.443 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-fuse-2:19.0.0-2311.g687eba7a.el9.x86_64 2/2 2024-04-17T02:21:01.443 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-fuse-2:19.0.0-2311.g687eba7a.el9.x86_64 1/2 2024-04-17T02:21:01.489 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:41 ago on Wed 17 Apr 2024 02:19:20 AM UTC. 2024-04-17T02:21:01.651 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-04-17T02:21:01.651 INFO:teuthology.orchestra.run.smithi017.stdout:======================================================================================== 2024-04-17T02:21:01.651 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-04-17T02:21:01.651 INFO:teuthology.orchestra.run.smithi017.stdout:======================================================================================== 2024-04-17T02:21:01.652 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-04-17T02:21:01.652 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2311.g687eba7a.el9 ceph-noarch 139 k 2024-04-17T02:21:01.652 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-04-17T02:21:01.652 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-17T02:21:01.652 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-17T02:21:01.652 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-17T02:21:01.652 INFO:teuthology.orchestra.run.smithi017.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-17T02:21:01.652 INFO:teuthology.orchestra.run.smithi017.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-17T02:21:01.652 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:01.652 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-04-17T02:21:01.652 INFO:teuthology.orchestra.run.smithi017.stdout:======================================================================================== 2024-04-17T02:21:01.652 INFO:teuthology.orchestra.run.smithi017.stdout:Install 6 Packages 2024-04-17T02:21:01.652 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:01.653 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 6.8 M 2024-04-17T02:21:01.653 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 33 M 2024-04-17T02:21:01.653 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-04-17T02:21:01.780 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-17T02:21:01.780 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:01.780 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-04-17T02:21:01.780 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-fuse-2:19.0.0-2311.g687eba7a.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-17T02:21:01.780 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:01.780 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-04-17T02:21:02.056 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-volume 2024-04-17T02:21:02.379 INFO:teuthology.orchestra.run.smithi017.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.4 MB/s | 248 kB 00:00 2024-04-17T02:21:02.488 INFO:teuthology.orchestra.run.smithi017.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 5.8 MB 00:00 2024-04-17T02:21:02.588 INFO:teuthology.orchestra.run.smithi017.stdout:(3/6): ceph-mgr-cephadm-19.0.0-2311.g687eba7a.e 359 kB/s | 139 kB 00:00 2024-04-17T02:21:02.670 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:01:34 ago on Wed 17 Apr 2024 02:19:28 AM UTC. 2024-04-17T02:21:02.826 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-04-17T02:21:02.827 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-17T02:21:02.827 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-04-17T02:21:02.827 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-17T02:21:02.827 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-04-17T02:21:02.827 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-volume noarch 2:19.0.0-2311.g687eba7a.el9 ceph-noarch 264 k 2024-04-17T02:21:02.827 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-04-17T02:21:02.827 INFO:teuthology.orchestra.run.smithi122.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-04-17T02:21:02.827 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:02.827 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-04-17T02:21:02.827 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-17T02:21:02.827 INFO:teuthology.orchestra.run.smithi122.stdout:Install 2 Packages 2024-04-17T02:21:02.827 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:02.828 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 332 k 2024-04-17T02:21:02.828 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 1.5 M 2024-04-17T02:21:02.828 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-04-17T02:21:02.855 INFO:teuthology.orchestra.run.smithi017.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 157 kB/s | 58 kB 00:00 2024-04-17T02:21:02.938 INFO:teuthology.orchestra.run.smithi017.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 146 kB/s | 51 kB 00:00 2024-04-17T02:21:02.960 INFO:teuthology.orchestra.run.smithi122.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 522 kB/s | 69 kB 00:00 2024-04-17T02:21:03.006 INFO:teuthology.orchestra.run.smithi017.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 879 kB/s | 548 kB 00:00 2024-04-17T02:21:03.007 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-04-17T02:21:03.008 INFO:teuthology.orchestra.run.smithi017.stdout:Total 5.0 MB/s | 6.8 MB 00:01 2024-04-17T02:21:03.023 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-04-17T02:21:03.035 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-04-17T02:21:03.035 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-04-17T02:21:03.132 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-04-17T02:21:03.133 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-04-17T02:21:03.251 INFO:teuthology.orchestra.run.smithi122.stdout:(2/2): ceph-volume-19.0.0-2311.g687eba7a.el9.no 623 kB/s | 264 kB 00:00 2024-04-17T02:21:03.252 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-04-17T02:21:03.253 INFO:teuthology.orchestra.run.smithi122.stdout:Total 781 kB/s | 332 kB 00:00 2024-04-17T02:21:03.253 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-04-17T02:21:03.262 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-04-17T02:21:03.262 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-04-17T02:21:03.304 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-04-17T02:21:03.304 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-04-17T02:21:03.458 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-04-17T02:21:03.460 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-04-17T02:21:03.635 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-17T02:21:03.649 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-04-17T02:21:03.692 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-17T02:21:03.696 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-volume-2:19.0.0-2311.g687eba7a.el9.noarch 2/2 2024-04-17T02:21:03.713 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-volume-2:19.0.0-2311.g687eba7a.el9.noarch 2/2 2024-04-17T02:21:03.713 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-17T02:21:03.713 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-17T02:21:03.713 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:04.244 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-17T02:21:04.323 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-17T02:21:04.394 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-17T02:21:04.415 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-volume-2:19.0.0-2311.g687eba7a.el9.noarch 1/2 2024-04-17T02:21:04.421 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2311.g687eba7a.el9.noarch 6/6 2024-04-17T02:21:04.731 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-04-17T02:21:04.731 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:04.731 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-04-17T02:21:04.731 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-volume-2:19.0.0-2311.g687eba7a.el9.noarch 2024-04-17T02:21:04.731 INFO:teuthology.orchestra.run.smithi122.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-17T02:21:04.731 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:04.731 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-04-17T02:21:05.077 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install librados-devel 2024-04-17T02:21:05.186 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2311.g687eba7a.el9.noarch 6/6 2024-04-17T02:21:05.187 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2311.g687eba7a.el9.noarch 1/6 2024-04-17T02:21:05.187 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-17T02:21:05.187 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-17T02:21:05.187 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-17T02:21:05.187 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-17T02:21:05.486 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-17T02:21:05.486 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:05.486 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-04-17T02:21:05.486 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm-2:19.0.0-2311.g687eba7a.el9.noarch 2024-04-17T02:21:05.486 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-17T02:21:05.486 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-17T02:21:05.486 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-17T02:21:05.486 INFO:teuthology.orchestra.run.smithi017.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-17T02:21:05.487 INFO:teuthology.orchestra.run.smithi017.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-17T02:21:05.487 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:05.487 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-04-17T02:21:05.688 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:01:37 ago on Wed 17 Apr 2024 02:19:28 AM UTC. 2024-04-17T02:21:05.715 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-fuse 2024-04-17T02:21:05.849 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-04-17T02:21:05.849 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-17T02:21:05.849 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repo Size 2024-04-17T02:21:05.849 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-17T02:21:05.850 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-04-17T02:21:05.850 INFO:teuthology.orchestra.run.smithi122.stdout: librados-devel x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 127 k 2024-04-17T02:21:05.850 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:05.850 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-04-17T02:21:05.850 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-17T02:21:05.850 INFO:teuthology.orchestra.run.smithi122.stdout:Install 1 Package 2024-04-17T02:21:05.850 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:05.850 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 127 k 2024-04-17T02:21:05.850 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 456 k 2024-04-17T02:21:05.850 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-04-17T02:21:06.166 INFO:teuthology.orchestra.run.smithi122.stdout:librados-devel-19.0.0-2311.g687eba7a.el9.x86_64 402 kB/s | 127 kB 00:00 2024-04-17T02:21:06.166 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-04-17T02:21:06.166 INFO:teuthology.orchestra.run.smithi122.stdout:Total 400 kB/s | 127 kB 00:00 2024-04-17T02:21:06.167 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-04-17T02:21:06.172 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-04-17T02:21:06.172 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-04-17T02:21:06.228 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-04-17T02:21:06.228 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-04-17T02:21:06.322 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:46 ago on Wed 17 Apr 2024 02:19:20 AM UTC. 2024-04-17T02:21:06.366 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-04-17T02:21:06.473 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librados-devel-2:19.0.0-2311.g687eba7a.el9.x86_64 1/1 2024-04-17T02:21:06.483 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-04-17T02:21:06.484 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-04-17T02:21:06.484 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-04-17T02:21:06.484 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-04-17T02:21:06.484 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-04-17T02:21:06.484 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 889 k 2024-04-17T02:21:06.484 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-04-17T02:21:06.484 INFO:teuthology.orchestra.run.smithi017.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-17T02:21:06.485 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:06.485 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-04-17T02:21:06.485 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-04-17T02:21:06.485 INFO:teuthology.orchestra.run.smithi017.stdout:Install 2 Packages 2024-04-17T02:21:06.485 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:06.485 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 968 k 2024-04-17T02:21:06.485 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 2.8 M 2024-04-17T02:21:06.485 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-04-17T02:21:06.618 INFO:teuthology.orchestra.run.smithi017.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 594 kB/s | 79 kB 00:00 2024-04-17T02:21:06.944 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librados-devel-2:19.0.0-2311.g687eba7a.el9.x86_64 1/1 2024-04-17T02:21:07.232 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados-devel-2:19.0.0-2311.g687eba7a.el9.x86_64 1/1 2024-04-17T02:21:07.232 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:07.232 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-04-17T02:21:07.232 INFO:teuthology.orchestra.run.smithi122.stdout: librados-devel-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:21:07.233 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:07.233 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-04-17T02:21:07.410 INFO:teuthology.orchestra.run.smithi017.stdout:(2/2): ceph-fuse-19.0.0-2311.g687eba7a.el9.x86_ 962 kB/s | 889 kB 00:00 2024-04-17T02:21:07.411 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-04-17T02:21:07.411 INFO:teuthology.orchestra.run.smithi017.stdout:Total 1.0 MB/s | 968 kB 00:00 2024-04-17T02:21:07.411 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-04-17T02:21:07.437 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-04-17T02:21:07.437 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-04-17T02:21:07.469 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install libcephfs2 2024-04-17T02:21:07.518 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-04-17T02:21:07.518 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-04-17T02:21:07.713 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-04-17T02:21:07.840 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-17T02:21:07.912 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-fuse-2:19.0.0-2311.g687eba7a.el9.x86_64 2/2 2024-04-17T02:21:08.077 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:01:40 ago on Wed 17 Apr 2024 02:19:28 AM UTC. 2024-04-17T02:21:08.181 INFO:teuthology.orchestra.run.smithi122.stdout:Package libcephfs2-2:19.0.0-2311.g687eba7a.el9.x86_64 is already installed. 2024-04-17T02:21:08.234 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-04-17T02:21:08.235 INFO:teuthology.orchestra.run.smithi122.stdout:Nothing to do. 2024-04-17T02:21:08.235 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-04-17T02:21:08.294 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install libcephfs-devel 2024-04-17T02:21:08.576 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-fuse-2:19.0.0-2311.g687eba7a.el9.x86_64 2/2 2024-04-17T02:21:08.576 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-fuse-2:19.0.0-2311.g687eba7a.el9.x86_64 1/2 2024-04-17T02:21:08.884 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:01:40 ago on Wed 17 Apr 2024 02:19:28 AM UTC. 2024-04-17T02:21:08.926 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-17T02:21:08.926 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:08.926 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-04-17T02:21:08.926 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse-2:19.0.0-2311.g687eba7a.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-17T02:21:08.926 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:08.926 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-04-17T02:21:09.040 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-04-17T02:21:09.041 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-17T02:21:09.041 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repo Size 2024-04-17T02:21:09.041 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-17T02:21:09.041 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-04-17T02:21:09.041 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs-devel x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 32 k 2024-04-17T02:21:09.041 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:09.042 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-04-17T02:21:09.042 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-17T02:21:09.042 INFO:teuthology.orchestra.run.smithi122.stdout:Install 1 Package 2024-04-17T02:21:09.042 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:09.042 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 32 k 2024-04-17T02:21:09.042 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 142 k 2024-04-17T02:21:09.042 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-04-17T02:21:09.190 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-volume 2024-04-17T02:21:09.804 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:49 ago on Wed 17 Apr 2024 02:19:20 AM UTC. 2024-04-17T02:21:09.968 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-04-17T02:21:09.969 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-04-17T02:21:09.969 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-04-17T02:21:09.969 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-04-17T02:21:09.969 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-04-17T02:21:09.969 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-volume noarch 2:19.0.0-2311.g687eba7a.el9 ceph-noarch 264 k 2024-04-17T02:21:09.969 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-04-17T02:21:09.969 INFO:teuthology.orchestra.run.smithi017.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-04-17T02:21:09.969 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:09.969 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-04-17T02:21:09.969 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-04-17T02:21:09.969 INFO:teuthology.orchestra.run.smithi017.stdout:Install 2 Packages 2024-04-17T02:21:09.970 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:09.970 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 332 k 2024-04-17T02:21:09.970 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 1.5 M 2024-04-17T02:21:09.970 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-04-17T02:21:10.089 INFO:teuthology.orchestra.run.smithi017.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 576 kB/s | 69 kB 00:00 2024-04-17T02:21:10.431 INFO:teuthology.orchestra.run.smithi017.stdout:(2/2): ceph-volume-19.0.0-2311.g687eba7a.el9.no 572 kB/s | 264 kB 00:00 2024-04-17T02:21:10.432 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-04-17T02:21:10.433 INFO:teuthology.orchestra.run.smithi017.stdout:Total 717 kB/s | 332 kB 00:00 2024-04-17T02:21:10.433 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-04-17T02:21:10.443 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-04-17T02:21:10.443 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-04-17T02:21:10.453 INFO:teuthology.orchestra.run.smithi122.stdout:libcephfs-devel-19.0.0-2311.g687eba7a.el9.x86_6 22 kB/s | 32 kB 00:01 2024-04-17T02:21:10.454 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-04-17T02:21:10.454 INFO:teuthology.orchestra.run.smithi122.stdout:Total 22 kB/s | 32 kB 00:01 2024-04-17T02:21:10.454 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-04-17T02:21:10.458 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-04-17T02:21:10.458 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-04-17T02:21:10.481 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-04-17T02:21:10.481 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-04-17T02:21:10.486 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-04-17T02:21:10.486 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-04-17T02:21:10.606 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-04-17T02:21:10.633 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-04-17T02:21:10.719 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephfs-devel-2:19.0.0-2311.g687eba7a.el9.x86_64 1/1 2024-04-17T02:21:10.820 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-04-17T02:21:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-volume-2:19.0.0-2311.g687eba7a.el9.noarch 2/2 2024-04-17T02:21:10.914 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-volume-2:19.0.0-2311.g687eba7a.el9.noarch 2/2 2024-04-17T02:21:10.915 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-17T02:21:10.915 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-17T02:21:10.915 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:11.091 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-2311.g687eba7a.el9.x86_64 1/1 2024-04-17T02:21:11.366 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephfs-devel-2:19.0.0-2311.g687eba7a.el9.x86_64 1/1 2024-04-17T02:21:11.366 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:11.366 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-04-17T02:21:11.366 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs-devel-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:21:11.366 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:11.366 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-04-17T02:21:11.538 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install librados2 2024-04-17T02:21:11.680 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-volume-2:19.0.0-2311.g687eba7a.el9.noarch 1/2 2024-04-17T02:21:11.995 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-04-17T02:21:11.995 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:11.995 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-04-17T02:21:11.995 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-volume-2:19.0.0-2311.g687eba7a.el9.noarch 2024-04-17T02:21:11.995 INFO:teuthology.orchestra.run.smithi017.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-17T02:21:11.995 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:11.995 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-04-17T02:21:12.135 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:01:44 ago on Wed 17 Apr 2024 02:19:28 AM UTC. 2024-04-17T02:21:12.238 INFO:teuthology.orchestra.run.smithi122.stdout:Package librados2-2:19.0.0-2311.g687eba7a.el9.x86_64 is already installed. 2024-04-17T02:21:12.290 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-04-17T02:21:12.291 INFO:teuthology.orchestra.run.smithi122.stdout:Nothing to do. 2024-04-17T02:21:12.291 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-04-17T02:21:12.347 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install librbd1 2024-04-17T02:21:12.358 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install librados-devel 2024-04-17T02:21:12.938 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:01:44 ago on Wed 17 Apr 2024 02:19:28 AM UTC. 2024-04-17T02:21:12.976 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:52 ago on Wed 17 Apr 2024 02:19:20 AM UTC. 2024-04-17T02:21:13.039 INFO:teuthology.orchestra.run.smithi122.stdout:Package librbd1-2:19.0.0-2311.g687eba7a.el9.x86_64 is already installed. 2024-04-17T02:21:13.091 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-04-17T02:21:13.092 INFO:teuthology.orchestra.run.smithi122.stdout:Nothing to do. 2024-04-17T02:21:13.092 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-04-17T02:21:13.136 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-04-17T02:21:13.137 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-04-17T02:21:13.137 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repo Size 2024-04-17T02:21:13.137 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-04-17T02:21:13.137 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-04-17T02:21:13.137 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 127 k 2024-04-17T02:21:13.137 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:13.137 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-04-17T02:21:13.137 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-04-17T02:21:13.137 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2024-04-17T02:21:13.137 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:13.138 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 127 k 2024-04-17T02:21:13.138 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 456 k 2024-04-17T02:21:13.138 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-04-17T02:21:13.148 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install python3-rados 2024-04-17T02:21:13.363 INFO:teuthology.orchestra.run.smithi017.stdout:librados-devel-19.0.0-2311.g687eba7a.el9.x86_64 564 kB/s | 127 kB 00:00 2024-04-17T02:21:13.364 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-04-17T02:21:13.364 INFO:teuthology.orchestra.run.smithi017.stdout:Total 560 kB/s | 127 kB 00:00 2024-04-17T02:21:13.364 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-04-17T02:21:13.370 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-04-17T02:21:13.370 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-04-17T02:21:13.429 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-04-17T02:21:13.429 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-04-17T02:21:13.578 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-04-17T02:21:13.690 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librados-devel-2:19.0.0-2311.g687eba7a.el9.x86_64 1/1 2024-04-17T02:21:13.750 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:01:45 ago on Wed 17 Apr 2024 02:19:28 AM UTC. 2024-04-17T02:21:13.851 INFO:teuthology.orchestra.run.smithi122.stdout:Package python3-rados-2:19.0.0-2311.g687eba7a.el9.x86_64 is already installed. 2024-04-17T02:21:13.902 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-04-17T02:21:13.903 INFO:teuthology.orchestra.run.smithi122.stdout:Nothing to do. 2024-04-17T02:21:13.903 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-04-17T02:21:13.952 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install python3-rgw 2024-04-17T02:21:14.126 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados-devel-2:19.0.0-2311.g687eba7a.el9.x86_64 1/1 2024-04-17T02:21:14.407 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados-devel-2:19.0.0-2311.g687eba7a.el9.x86_64 1/1 2024-04-17T02:21:14.407 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:14.407 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-04-17T02:21:14.407 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:21:14.407 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:14.407 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-04-17T02:21:14.549 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:01:46 ago on Wed 17 Apr 2024 02:19:28 AM UTC. 2024-04-17T02:21:14.633 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install libcephfs2 2024-04-17T02:21:14.650 INFO:teuthology.orchestra.run.smithi122.stdout:Package python3-rgw-2:19.0.0-2311.g687eba7a.el9.x86_64 is already installed. 2024-04-17T02:21:14.702 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-04-17T02:21:14.702 INFO:teuthology.orchestra.run.smithi122.stdout:Nothing to do. 2024-04-17T02:21:14.703 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-04-17T02:21:14.764 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install python3-cephfs 2024-04-17T02:21:15.254 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:55 ago on Wed 17 Apr 2024 02:19:20 AM UTC. 2024-04-17T02:21:15.358 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:01:47 ago on Wed 17 Apr 2024 02:19:28 AM UTC. 2024-04-17T02:21:15.359 INFO:teuthology.orchestra.run.smithi017.stdout:Package libcephfs2-2:19.0.0-2311.g687eba7a.el9.x86_64 is already installed. 2024-04-17T02:21:15.416 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-04-17T02:21:15.417 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-04-17T02:21:15.417 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-04-17T02:21:15.459 INFO:teuthology.orchestra.run.smithi122.stdout:Package python3-cephfs-2:19.0.0-2311.g687eba7a.el9.x86_64 is already installed. 2024-04-17T02:21:15.478 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install libcephfs-devel 2024-04-17T02:21:15.511 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-04-17T02:21:15.512 INFO:teuthology.orchestra.run.smithi122.stdout:Nothing to do. 2024-04-17T02:21:15.512 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-04-17T02:21:15.560 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install python3-rbd 2024-04-17T02:21:16.085 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:56 ago on Wed 17 Apr 2024 02:19:20 AM UTC. 2024-04-17T02:21:16.189 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:01:48 ago on Wed 17 Apr 2024 02:19:28 AM UTC. 2024-04-17T02:21:16.245 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-04-17T02:21:16.246 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-04-17T02:21:16.246 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repo Size 2024-04-17T02:21:16.246 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-04-17T02:21:16.247 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-04-17T02:21:16.247 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 32 k 2024-04-17T02:21:16.247 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:16.247 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-04-17T02:21:16.247 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-04-17T02:21:16.247 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2024-04-17T02:21:16.247 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:16.247 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 32 k 2024-04-17T02:21:16.247 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 142 k 2024-04-17T02:21:16.247 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-04-17T02:21:16.291 INFO:teuthology.orchestra.run.smithi122.stdout:Package python3-rbd-2:19.0.0-2311.g687eba7a.el9.x86_64 is already installed. 2024-04-17T02:21:16.343 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-04-17T02:21:16.344 INFO:teuthology.orchestra.run.smithi122.stdout:Nothing to do. 2024-04-17T02:21:16.344 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-04-17T02:21:16.397 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install rbd-fuse 2024-04-17T02:21:16.996 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:01:48 ago on Wed 17 Apr 2024 02:19:28 AM UTC. 2024-04-17T02:21:17.148 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-04-17T02:21:17.149 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-17T02:21:17.149 INFO:teuthology.orchestra.run.smithi122.stdout: Package Architecture Version Repository Size 2024-04-17T02:21:17.149 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-17T02:21:17.149 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-04-17T02:21:17.149 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-fuse x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 85 k 2024-04-17T02:21:17.149 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:17.149 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-04-17T02:21:17.150 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-17T02:21:17.150 INFO:teuthology.orchestra.run.smithi122.stdout:Install 1 Package 2024-04-17T02:21:17.150 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:17.150 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 85 k 2024-04-17T02:21:17.150 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 231 k 2024-04-17T02:21:17.150 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-04-17T02:21:17.464 INFO:teuthology.orchestra.run.smithi122.stdout:rbd-fuse-19.0.0-2311.g687eba7a.el9.x86_64.rpm 271 kB/s | 85 kB 00:00 2024-04-17T02:21:17.465 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-04-17T02:21:17.465 INFO:teuthology.orchestra.run.smithi122.stdout:Total 270 kB/s | 85 kB 00:00 2024-04-17T02:21:17.465 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-04-17T02:21:17.472 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-04-17T02:21:17.472 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-04-17T02:21:17.528 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-04-17T02:21:17.528 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-04-17T02:21:17.666 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-04-17T02:21:17.779 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-fuse-2:19.0.0-2311.g687eba7a.el9.x86_64 1/1 2024-04-17T02:21:17.850 INFO:teuthology.orchestra.run.smithi017.stdout:libcephfs-devel-19.0.0-2311.g687eba7a.el9.x86_6 20 kB/s | 32 kB 00:01 2024-04-17T02:21:17.851 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-04-17T02:21:17.851 INFO:teuthology.orchestra.run.smithi017.stdout:Total 20 kB/s | 32 kB 00:01 2024-04-17T02:21:17.851 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-04-17T02:21:17.856 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-04-17T02:21:17.856 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-04-17T02:21:17.885 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-04-17T02:21:17.885 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-04-17T02:21:18.008 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-04-17T02:21:18.119 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs-devel-2:19.0.0-2311.g687eba7a.el9.x86_64 1/1 2024-04-17T02:21:18.247 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: rbd-fuse-2:19.0.0-2311.g687eba7a.el9.x86_64 1/1 2024-04-17T02:21:18.523 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-2311.g687eba7a.el9.x86_64 1/1 2024-04-17T02:21:18.565 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-fuse-2:19.0.0-2311.g687eba7a.el9.x86_64 1/1 2024-04-17T02:21:18.565 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:18.565 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-04-17T02:21:18.565 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-fuse-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:21:18.565 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:18.565 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-04-17T02:21:18.777 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install rbd-mirror 2024-04-17T02:21:18.793 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs-devel-2:19.0.0-2311.g687eba7a.el9.x86_64 1/1 2024-04-17T02:21:18.793 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:18.793 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-04-17T02:21:18.793 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:21:18.794 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:18.794 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-04-17T02:21:18.968 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install librados2 2024-04-17T02:21:19.389 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:01:51 ago on Wed 17 Apr 2024 02:19:28 AM UTC. 2024-04-17T02:21:19.545 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-04-17T02:21:19.546 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-17T02:21:19.546 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repo Size 2024-04-17T02:21:19.546 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-17T02:21:19.546 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-04-17T02:21:19.546 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-mirror x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 3.1 M 2024-04-17T02:21:19.546 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:19.546 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-04-17T02:21:19.546 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-17T02:21:19.547 INFO:teuthology.orchestra.run.smithi122.stdout:Install 1 Package 2024-04-17T02:21:19.547 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:19.547 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 3.1 M 2024-04-17T02:21:19.547 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 13 M 2024-04-17T02:21:19.547 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-04-17T02:21:19.574 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:59 ago on Wed 17 Apr 2024 02:19:20 AM UTC. 2024-04-17T02:21:19.680 INFO:teuthology.orchestra.run.smithi017.stdout:Package librados2-2:19.0.0-2311.g687eba7a.el9.x86_64 is already installed. 2024-04-17T02:21:19.735 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-04-17T02:21:19.736 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-04-17T02:21:19.736 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-04-17T02:21:19.788 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install librbd1 2024-04-17T02:21:20.135 INFO:teuthology.orchestra.run.smithi122.stdout:rbd-mirror-19.0.0-2311.g687eba7a.el9.x86_64.rpm 5.3 MB/s | 3.1 MB 00:00 2024-04-17T02:21:20.136 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-04-17T02:21:20.136 INFO:teuthology.orchestra.run.smithi122.stdout:Total 5.2 MB/s | 3.1 MB 00:00 2024-04-17T02:21:20.136 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-04-17T02:21:20.145 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-04-17T02:21:20.145 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-04-17T02:21:20.218 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-04-17T02:21:20.219 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-04-17T02:21:20.399 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:02:00 ago on Wed 17 Apr 2024 02:19:20 AM UTC. 2024-04-17T02:21:20.506 INFO:teuthology.orchestra.run.smithi017.stdout:Package librbd1-2:19.0.0-2311.g687eba7a.el9.x86_64 is already installed. 2024-04-17T02:21:20.560 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-04-17T02:21:20.561 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-04-17T02:21:20.561 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-04-17T02:21:20.613 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install python3-rados 2024-04-17T02:21:20.642 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-04-17T02:21:20.711 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-mirror-2:19.0.0-2311.g687eba7a.el9.x86_64 1/1 2024-04-17T02:21:20.736 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2311.g687eba7a.el9.x86_64 1/1 2024-04-17T02:21:20.736 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-17T02:21:20.737 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-17T02:21:20.737 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-17T02:21:20.737 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-17T02:21:20.737 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:21.225 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:02:01 ago on Wed 17 Apr 2024 02:19:20 AM UTC. 2024-04-17T02:21:21.330 INFO:teuthology.orchestra.run.smithi017.stdout:Package python3-rados-2:19.0.0-2311.g687eba7a.el9.x86_64 is already installed. 2024-04-17T02:21:21.384 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-04-17T02:21:21.385 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-04-17T02:21:21.385 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-04-17T02:21:21.434 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install python3-rgw 2024-04-17T02:21:21.845 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-mirror-2:19.0.0-2311.g687eba7a.el9.x86_64 1/1 2024-04-17T02:21:21.845 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:21.845 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-04-17T02:21:21.845 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-mirror-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:21:21.845 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:21.845 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-04-17T02:21:22.042 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:02:02 ago on Wed 17 Apr 2024 02:19:20 AM UTC. 2024-04-17T02:21:22.097 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install rbd-nbd 2024-04-17T02:21:22.146 INFO:teuthology.orchestra.run.smithi017.stdout:Package python3-rgw-2:19.0.0-2311.g687eba7a.el9.x86_64 is already installed. 2024-04-17T02:21:22.201 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-04-17T02:21:22.202 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-04-17T02:21:22.202 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-04-17T02:21:22.252 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install python3-cephfs 2024-04-17T02:21:22.712 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:01:54 ago on Wed 17 Apr 2024 02:19:28 AM UTC. 2024-04-17T02:21:22.859 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:02:02 ago on Wed 17 Apr 2024 02:19:20 AM UTC. 2024-04-17T02:21:22.864 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-04-17T02:21:22.865 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-17T02:21:22.865 INFO:teuthology.orchestra.run.smithi122.stdout: Package Architecture Version Repository Size 2024-04-17T02:21:22.865 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-17T02:21:22.865 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-04-17T02:21:22.865 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-nbd x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 171 k 2024-04-17T02:21:22.865 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:22.865 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-04-17T02:21:22.866 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-17T02:21:22.866 INFO:teuthology.orchestra.run.smithi122.stdout:Install 1 Package 2024-04-17T02:21:22.866 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:22.866 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 171 k 2024-04-17T02:21:22.866 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 494 k 2024-04-17T02:21:22.867 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-04-17T02:21:22.970 INFO:teuthology.orchestra.run.smithi017.stdout:Package python3-cephfs-2:19.0.0-2311.g687eba7a.el9.x86_64 is already installed. 2024-04-17T02:21:23.027 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-04-17T02:21:23.027 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-04-17T02:21:23.028 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-04-17T02:21:23.084 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install python3-rbd 2024-04-17T02:21:23.698 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:02:03 ago on Wed 17 Apr 2024 02:19:20 AM UTC. 2024-04-17T02:21:23.755 INFO:teuthology.orchestra.run.smithi122.stdout:rbd-nbd-19.0.0-2311.g687eba7a.el9.x86_64.rpm 192 kB/s | 171 kB 00:00 2024-04-17T02:21:23.755 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-04-17T02:21:23.755 INFO:teuthology.orchestra.run.smithi122.stdout:Total 192 kB/s | 171 kB 00:00 2024-04-17T02:21:23.756 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-04-17T02:21:23.764 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-04-17T02:21:23.764 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-04-17T02:21:23.803 INFO:teuthology.orchestra.run.smithi017.stdout:Package python3-rbd-2:19.0.0-2311.g687eba7a.el9.x86_64 is already installed. 2024-04-17T02:21:23.822 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-04-17T02:21:23.823 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-04-17T02:21:23.858 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-04-17T02:21:23.860 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-04-17T02:21:23.860 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-04-17T02:21:23.910 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install rbd-fuse 2024-04-17T02:21:23.983 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-04-17T02:21:24.087 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-nbd-2:19.0.0-2311.g687eba7a.el9.x86_64 1/1 2024-04-17T02:21:24.510 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: rbd-nbd-2:19.0.0-2311.g687eba7a.el9.x86_64 1/1 2024-04-17T02:21:24.518 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:02:04 ago on Wed 17 Apr 2024 02:19:20 AM UTC. 2024-04-17T02:21:24.681 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-04-17T02:21:24.681 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-04-17T02:21:24.682 INFO:teuthology.orchestra.run.smithi017.stdout: Package Architecture Version Repository Size 2024-04-17T02:21:24.682 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-04-17T02:21:24.682 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-04-17T02:21:24.682 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 85 k 2024-04-17T02:21:24.682 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:24.682 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-04-17T02:21:24.682 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-04-17T02:21:24.682 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2024-04-17T02:21:24.682 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:24.682 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 85 k 2024-04-17T02:21:24.682 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 231 k 2024-04-17T02:21:24.682 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-04-17T02:21:24.830 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-nbd-2:19.0.0-2311.g687eba7a.el9.x86_64 1/1 2024-04-17T02:21:24.830 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:24.831 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-04-17T02:21:24.831 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-nbd-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:21:24.831 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:24.831 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-04-17T02:21:24.995 INFO:teuthology.orchestra.run.smithi017.stdout:rbd-fuse-19.0.0-2311.g687eba7a.el9.x86_64.rpm 273 kB/s | 85 kB 00:00 2024-04-17T02:21:24.996 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-04-17T02:21:24.996 INFO:teuthology.orchestra.run.smithi017.stdout:Total 271 kB/s | 85 kB 00:00 2024-04-17T02:21:24.996 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-04-17T02:21:25.003 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-04-17T02:21:25.004 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-04-17T02:21:25.062 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-04-17T02:21:25.062 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-04-17T02:21:25.076 DEBUG:teuthology.parallel:result is None 2024-04-17T02:21:25.208 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-04-17T02:21:25.296 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-fuse-2:19.0.0-2311.g687eba7a.el9.x86_64 1/1 2024-04-17T02:21:25.681 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: rbd-fuse-2:19.0.0-2311.g687eba7a.el9.x86_64 1/1 2024-04-17T02:21:25.966 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-fuse-2:19.0.0-2311.g687eba7a.el9.x86_64 1/1 2024-04-17T02:21:25.966 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:25.966 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-04-17T02:21:25.966 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:21:25.966 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:25.966 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-04-17T02:21:26.193 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install rbd-mirror 2024-04-17T02:21:26.801 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:02:06 ago on Wed 17 Apr 2024 02:19:20 AM UTC. 2024-04-17T02:21:26.961 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-04-17T02:21:26.961 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-04-17T02:21:26.961 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repo Size 2024-04-17T02:21:26.962 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-04-17T02:21:26.962 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-04-17T02:21:26.962 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 3.1 M 2024-04-17T02:21:26.962 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:26.962 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-04-17T02:21:26.962 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-04-17T02:21:26.962 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2024-04-17T02:21:26.962 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:26.962 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 3.1 M 2024-04-17T02:21:26.962 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 13 M 2024-04-17T02:21:26.962 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-04-17T02:21:28.098 INFO:teuthology.orchestra.run.smithi017.stdout:rbd-mirror-19.0.0-2311.g687eba7a.el9.x86_64.rpm 2.7 MB/s | 3.1 MB 00:01 2024-04-17T02:21:28.099 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-04-17T02:21:28.099 INFO:teuthology.orchestra.run.smithi017.stdout:Total 2.7 MB/s | 3.1 MB 00:01 2024-04-17T02:21:28.100 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-04-17T02:21:28.112 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-04-17T02:21:28.112 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-04-17T02:21:28.191 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-04-17T02:21:28.192 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-04-17T02:21:28.641 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-04-17T02:21:28.716 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-mirror-2:19.0.0-2311.g687eba7a.el9.x86_64 1/1 2024-04-17T02:21:28.741 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2311.g687eba7a.el9.x86_64 1/1 2024-04-17T02:21:28.742 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-17T02:21:28.742 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-17T02:21:28.742 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-17T02:21:28.742 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-17T02:21:28.742 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:29.863 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-mirror-2:19.0.0-2311.g687eba7a.el9.x86_64 1/1 2024-04-17T02:21:29.864 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:29.864 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-04-17T02:21:29.864 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:21:29.864 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:29.864 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-04-17T02:21:30.077 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install rbd-nbd 2024-04-17T02:21:30.691 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:02:10 ago on Wed 17 Apr 2024 02:19:20 AM UTC. 2024-04-17T02:21:30.851 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-04-17T02:21:30.851 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-04-17T02:21:30.851 INFO:teuthology.orchestra.run.smithi017.stdout: Package Architecture Version Repository Size 2024-04-17T02:21:30.851 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-04-17T02:21:30.851 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-04-17T02:21:30.851 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd x86_64 2:19.0.0-2311.g687eba7a.el9 ceph 171 k 2024-04-17T02:21:30.851 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:30.852 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-04-17T02:21:30.852 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-04-17T02:21:30.852 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2024-04-17T02:21:30.852 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:30.852 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 171 k 2024-04-17T02:21:30.852 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 494 k 2024-04-17T02:21:30.852 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-04-17T02:21:31.260 INFO:teuthology.orchestra.run.smithi017.stdout:rbd-nbd-19.0.0-2311.g687eba7a.el9.x86_64.rpm 418 kB/s | 171 kB 00:00 2024-04-17T02:21:31.261 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-04-17T02:21:31.261 INFO:teuthology.orchestra.run.smithi017.stdout:Total 417 kB/s | 171 kB 00:00 2024-04-17T02:21:31.261 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-04-17T02:21:31.270 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-04-17T02:21:31.270 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-04-17T02:21:31.329 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-04-17T02:21:31.329 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-04-17T02:21:31.475 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-04-17T02:21:31.578 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-nbd-2:19.0.0-2311.g687eba7a.el9.x86_64 1/1 2024-04-17T02:21:32.048 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: rbd-nbd-2:19.0.0-2311.g687eba7a.el9.x86_64 1/1 2024-04-17T02:21:32.338 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-nbd-2:19.0.0-2311.g687eba7a.el9.x86_64 1/1 2024-04-17T02:21:32.338 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:32.339 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-04-17T02:21:32.339 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd-2:19.0.0-2311.g687eba7a.el9.x86_64 2024-04-17T02:21:32.339 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:32.339 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-04-17T02:21:32.589 DEBUG:teuthology.parallel:result is None 2024-04-17T02:21:32.589 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=687eba7a6534970dd256b49bc87e74b01871539e 2024-04-17T02:21:32.740 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-17T02:21:32.761 INFO:teuthology.orchestra.run.smithi017.stdout:19.0.0-2311.g687eba7a.el9 2024-04-17T02:21:32.762 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2311.g687eba7a.el9 2024-04-17T02:21:32.762 INFO:teuthology.task.install:The correct ceph version 19.0.0-2311.g687eba7a is installed. 2024-04-17T02:21:32.764 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=687eba7a6534970dd256b49bc87e74b01871539e 2024-04-17T02:21:33.021 DEBUG:teuthology.orchestra.run.smithi122:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-17T02:21:33.047 INFO:teuthology.orchestra.run.smithi122.stdout:19.0.0-2311.g687eba7a.el9 2024-04-17T02:21:33.047 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2311.g687eba7a.el9 2024-04-17T02:21:33.047 INFO:teuthology.task.install:The correct ceph version 19.0.0-2311.g687eba7a is installed. 2024-04-17T02:21:33.049 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-17T02:21:33.049 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-04-17T02:21:33.050 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-17T02:21:33.079 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-17T02:21:33.079 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-17T02:21:33.121 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-17T02:21:33.122 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-04-17T02:21:33.122 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/daemon-helper 2024-04-17T02:21:33.149 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-17T02:21:33.218 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-17T02:21:33.218 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/daemon-helper 2024-04-17T02:21:33.249 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-17T02:21:33.320 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-17T02:21:33.320 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-04-17T02:21:33.320 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-17T02:21:33.349 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-17T02:21:33.416 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-17T02:21:33.416 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-17T02:21:33.450 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-17T02:21:33.520 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-17T02:21:33.520 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-04-17T02:21:33.520 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/stdin-killer 2024-04-17T02:21:33.549 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-17T02:21:33.617 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-17T02:21:33.617 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/stdin-killer 2024-04-17T02:21:33.647 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-17T02:21:33.717 INFO:teuthology.run_tasks:Running task ceph... 2024-04-17T02:21:33.806 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-17T02:21:33.806 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 777 /var/log/ceph 2024-04-17T02:21:33.809 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 777 /var/log/ceph 2024-04-17T02:21:33.838 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-17T02:21:33.838 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-17T02:21:33.877 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-17T02:21:33.906 INFO:tasks.ceph:Creating extra log directories... 2024-04-17T02:21:33.906 DEBUG:teuthology.orchestra.run.smithi017:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-17T02:21:33.945 DEBUG:teuthology.orchestra.run.smithi122:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-17T02:21:33.982 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-17T02:21:33.982 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-17T02:21:33.982 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-17T02:21:33.982 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-04-17T02:21:33.982 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-17T02:21:34.026 DEBUG:teuthology.orchestra.run.smithi017:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-17T02:21:34.148 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-17T02:21:34.176 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-17T02:21:34.177 DEBUG:teuthology.orchestra.run.smithi122:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-17T02:21:34.194 DEBUG:teuthology.orchestra.run.smithi122:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-17T02:21:34.315 DEBUG:teuthology.orchestra.run.smithi122:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-17T02:21:34.348 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-17T02:21:34.348 INFO:tasks.ceph:config {'conf': {'client': {'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'global': {'mon election default strategy': 3}, 'mds': {'debug mgrc': 20}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mgr ttl cache expire seconds': 5}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_', 'replacing it with standby', 'No standby daemons available', '\\(POOL_APP_NOT_ENABLED\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-17T02:21:34.349 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2024-04-16_23:25:35-rados-wip-yuriw-testing-20240416.150233-distro-default-smithi/7659500', 'branch': 'wip-yuriw-testing-20240416.150233', 'description': 'rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{centos_latest} tasks/workunits}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7659500', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2024-04-16_23:25:35-rados-wip-yuriw-testing-20240416.150233-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 2, 'size': 30}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuriw-testing-20240416.150233'}, 'ceph': {'conf': {'client': {'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'global': {'mon election default strategy': 3}, 'mds': {'debug mgrc': 20}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mgr ttl cache expire seconds': 5}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '687eba7a6534970dd256b49bc87e74b01871539e'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '687eba7a6534970dd256b49bc87e74b01871539e'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuriw-testing-20240416.150233', 'sha1': '687eba7a6534970dd256b49bc87e74b01871539e'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 99, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mgr.x', 'mon.a', 'mon.c', 'mds.a', 'mds.c', 'osd.0', 'client.0'], ['mgr.y', 'mgr.z', 'mon.b', 'mds.b', 'osd.1', 'osd.2', 'osd.3', 'client.1']], 'seed': 2282, 'sha1': '687eba7a6534970dd256b49bc87e74b01871539e', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-yuriw-testing-20240416.150233', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_687eba7a6534970dd256b49bc87e74b01871539e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '687eba7a6534970dd256b49bc87e74b01871539e', 'targets': {'smithi017.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKw7DNo7DRsd3smle4Eo4f0gzEt4yiQ7NaTitvSCxO1W0NupsW+/sORRdfQ50XC4l2HwRUefFhZi/aALKehqEMg=', 'smithi122.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPLT+tXeF7lbvd5wFtDB0xF+4ogVq6HNLgbzducVjtjk6pVbxlD3LGMQpj2oJq6/cg/NpFFsGyzNxPKonVWE17U='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'log-ignorelist': ['overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_', 'replacing it with standby', 'No standby daemons available', '\\(POOL_APP_NOT_ENABLED\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'wait-for-scrub': False, 'conf': {'client': {'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'global': {'mon election default strategy': 3}, 'mds': {'debug mgrc': 20}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mgr ttl cache expire seconds': 5}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'sha1': '687eba7a6534970dd256b49bc87e74b01871539e', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ['mgr/test_localpool.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '6c637841c215537a4502385240412f1966e0faab', 'timestamp': '2024-04-16_23:25:35', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-17T02:21:34.349 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-17T02:21:34.352 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-17T02:21:34.399 DEBUG:teuthology.orchestra.run.smithi017:> sudo install -d -m0777 -- /var/run/ceph 2024-04-17T02:21:34.407 DEBUG:teuthology.orchestra.run.smithi122:> sudo install -d -m0777 -- /var/run/ceph 2024-04-17T02:21:34.467 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-04-17T02:21:34.467 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/scratch_devs of=/dev/stdout 2024-04-17T02:21:34.488 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-17T02:21:34.489 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_1 2024-04-17T02:21:34.543 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-17T02:21:34.544 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T02:21:34.544 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-04-17T02:21:34.544 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T02:21:34.544 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-04-17T02:21:34.544 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-04-17 02:21:28.989976203 +0000 2024-04-17T02:21:34.544 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-04-17 02:18:31.599919844 +0000 2024-04-17T02:21:34.544 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-04-17 02:18:31.599919844 +0000 2024-04-17T02:21:34.544 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-04-17 02:18:31.599919844 +0000 2024-04-17T02:21:34.544 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-17T02:21:34.609 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-04-17T02:21:34.610 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-04-17T02:21:34.610 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 8.1544e-05 s, 6.3 MB/s 2024-04-17T02:21:34.611 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-17T02:21:34.666 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_2 2024-04-17T02:21:34.721 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-17T02:21:34.722 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T02:21:34.722 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-04-17T02:21:34.722 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T02:21:34.722 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-04-17T02:21:34.722 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-04-17 02:21:28.989976203 +0000 2024-04-17T02:21:34.722 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-04-17 02:18:31.952916760 +0000 2024-04-17T02:21:34.722 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-04-17 02:18:31.952916760 +0000 2024-04-17T02:21:34.722 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-04-17 02:18:31.952916760 +0000 2024-04-17T02:21:34.723 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-17T02:21:34.788 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-04-17T02:21:34.788 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-04-17T02:21:34.788 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 9.7005e-05 s, 5.3 MB/s 2024-04-17T02:21:34.789 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-17T02:21:34.845 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_3 2024-04-17T02:21:34.901 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-17T02:21:34.901 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T02:21:34.901 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-17T02:21:34.901 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T02:21:34.901 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-04-17T02:21:34.901 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-04-17 02:21:28.989976203 +0000 2024-04-17T02:21:34.901 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-04-17 02:18:32.282913877 +0000 2024-04-17T02:21:34.901 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-04-17 02:18:32.282913877 +0000 2024-04-17T02:21:34.901 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-04-17 02:18:32.282913877 +0000 2024-04-17T02:21:34.902 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-17T02:21:34.966 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-04-17T02:21:34.967 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-04-17T02:21:34.967 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 9.6961e-05 s, 5.3 MB/s 2024-04-17T02:21:34.968 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-17T02:21:35.024 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_4 2024-04-17T02:21:35.079 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-17T02:21:35.079 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T02:21:35.080 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-17T02:21:35.080 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T02:21:35.080 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-04-17T02:21:35.080 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-04-17 02:21:28.990976194 +0000 2024-04-17T02:21:35.080 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-04-17 02:18:32.627910863 +0000 2024-04-17T02:21:35.080 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-04-17 02:18:32.627910863 +0000 2024-04-17T02:21:35.080 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-04-17 02:18:32.627910863 +0000 2024-04-17T02:21:35.080 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-17T02:21:35.146 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-04-17T02:21:35.146 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-04-17T02:21:35.146 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 9.5924e-05 s, 5.3 MB/s 2024-04-17T02:21:35.147 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-17T02:21:35.203 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-17T02:21:35.204 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-17T02:21:35.204 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/scratch_devs of=/dev/stdout 2024-04-17T02:21:35.222 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-17T02:21:35.223 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_1 2024-04-17T02:21:35.280 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-17T02:21:35.280 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T02:21:35.280 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-04-17T02:21:35.280 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T02:21:35.280 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-04-17T02:21:35.280 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-04-17 02:21:20.985095718 +0000 2024-04-17T02:21:35.280 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-04-17 02:18:29.903010071 +0000 2024-04-17T02:21:35.280 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-04-17 02:18:29.903010071 +0000 2024-04-17T02:21:35.280 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-04-17 02:18:29.903010071 +0000 2024-04-17T02:21:35.281 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-17T02:21:35.350 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-04-17T02:21:35.351 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-04-17T02:21:35.351 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000217836 s, 2.4 MB/s 2024-04-17T02:21:35.352 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-17T02:21:35.410 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_2 2024-04-17T02:21:35.467 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-17T02:21:35.467 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T02:21:35.468 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-04-17T02:21:35.468 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T02:21:35.468 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-04-17T02:21:35.468 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-04-17 02:21:20.985095718 +0000 2024-04-17T02:21:35.468 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-04-17 02:18:30.252002103 +0000 2024-04-17T02:21:35.468 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-04-17 02:18:30.252002103 +0000 2024-04-17T02:21:35.468 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-04-17 02:18:30.252002103 +0000 2024-04-17T02:21:35.469 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-17T02:21:35.537 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-04-17T02:21:35.537 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-04-17T02:21:35.537 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000192667 s, 2.7 MB/s 2024-04-17T02:21:35.538 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-17T02:21:35.595 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_3 2024-04-17T02:21:35.652 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-17T02:21:35.652 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T02:21:35.652 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-04-17T02:21:35.652 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T02:21:35.652 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-04-17T02:21:35.652 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-04-17 02:21:20.985095718 +0000 2024-04-17T02:21:35.652 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-04-17 02:18:30.599994159 +0000 2024-04-17T02:21:35.652 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-04-17 02:18:30.599994159 +0000 2024-04-17T02:21:35.652 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-04-17 02:18:30.599994159 +0000 2024-04-17T02:21:35.653 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-17T02:21:35.718 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-04-17T02:21:35.719 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-04-17T02:21:35.719 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000168069 s, 3.0 MB/s 2024-04-17T02:21:35.720 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-17T02:21:35.776 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_4 2024-04-17T02:21:35.832 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-17T02:21:35.832 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T02:21:35.832 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-17T02:21:35.832 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T02:21:35.832 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-04-17T02:21:35.832 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-04-17 02:21:20.986095695 +0000 2024-04-17T02:21:35.832 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-04-17 02:18:30.941986352 +0000 2024-04-17T02:21:35.832 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-04-17 02:18:30.941986352 +0000 2024-04-17T02:21:35.832 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-04-17 02:18:30.941986352 +0000 2024-04-17T02:21:35.833 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-17T02:21:35.898 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-04-17T02:21:35.898 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-04-17T02:21:35.898 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000210127 s, 2.4 MB/s 2024-04-17T02:21:35.899 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-17T02:21:35.956 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-17T02:21:35.956 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi017.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi122.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-04-17T02:21:35.956 INFO:tasks.ceph:Generating config... 2024-04-17T02:21:35.957 INFO:tasks.ceph:[client] debug client = 20 2024-04-17T02:21:35.957 INFO:tasks.ceph:[client] debug mgrc = 20 2024-04-17T02:21:35.957 INFO:tasks.ceph:[client] debug ms = 1 2024-04-17T02:21:35.958 INFO:tasks.ceph:[global] mon election default strategy = 3 2024-04-17T02:21:35.958 INFO:tasks.ceph:[mds] debug mgrc = 20 2024-04-17T02:21:35.958 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-17T02:21:35.958 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-17T02:21:35.958 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-17T02:21:35.958 INFO:tasks.ceph:[mgr] mgr ttl cache expire seconds = 5 2024-04-17T02:21:35.958 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-17T02:21:35.958 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-17T02:21:35.958 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-17T02:21:35.958 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-17T02:21:35.958 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2024-04-17T02:21:35.958 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-04-17T02:21:35.958 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-17T02:21:35.958 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-17T02:21:35.959 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-17T02:21:35.959 INFO:tasks.ceph:[osd] debug mgrc = 20 2024-04-17T02:21:35.959 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-17T02:21:35.959 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-17T02:21:35.959 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-17T02:21:35.959 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-17T02:21:35.959 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-17T02:21:35.959 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-17T02:21:35.959 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-17T02:21:35.959 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-17T02:21:35.960 INFO:tasks.ceph:Setting up mon.a... 2024-04-17T02:21:35.960 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-17T02:21:36.018 INFO:teuthology.orchestra.run.smithi017.stdout:creating /etc/ceph/ceph.keyring 2024-04-17T02:21:36.021 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-17T02:21:36.069 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-17T02:21:36.097 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.17'), ('mon.c', '[v2:172.21.15.17:3301,v1:172.21.15.17:6790]'), ('mon.b', '172.21.15.122')] 2024-04-17T02:21:36.098 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.17,[v2:172.21.15.17:3301,v1:172.21.15.17:6790],172.21.15.122', 'mon election default strategy': 3}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'mgr ttl cache expire seconds': 5}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds': {'debug mgrc': 20}} 2024-04-17T02:21:36.099 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-04-17T02:21:36.099 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-17T02:21:36.153 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.17 --addv c '[v2:172.21.15.17:3301,v1:172.21.15.17:6790]' --add b 172.21.15.122 --print /home/ubuntu/cephtest/ceph.monmap 2024-04-17T02:21:36.239 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-17T02:21:36.239 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: generated fsid 7cbfae20-b10d-41da-92b7-cbd5c1632e23 2024-04-17T02:21:36.239 INFO:teuthology.orchestra.run.smithi017.stdout:setting min_mon_release = quincy 2024-04-17T02:21:36.239 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 0 2024-04-17T02:21:36.240 INFO:teuthology.orchestra.run.smithi017.stdout:fsid 7cbfae20-b10d-41da-92b7-cbd5c1632e23 2024-04-17T02:21:36.240 INFO:teuthology.orchestra.run.smithi017.stdout:last_changed 2024-04-17T02:21:36.239511+0000 2024-04-17T02:21:36.240 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-04-17T02:21:36.239511+0000 2024-04-17T02:21:36.240 INFO:teuthology.orchestra.run.smithi017.stdout:min_mon_release 17 (quincy) 2024-04-17T02:21:36.240 INFO:teuthology.orchestra.run.smithi017.stdout:election_strategy: 3 2024-04-17T02:21:36.240 INFO:teuthology.orchestra.run.smithi017.stdout:0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-04-17T02:21:36.240 INFO:teuthology.orchestra.run.smithi017.stdout:1: [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon.b 2024-04-17T02:21:36.240 INFO:teuthology.orchestra.run.smithi017.stdout:2: [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] mon.c 2024-04-17T02:21:36.240 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-17T02:21:36.241 DEBUG:teuthology.orchestra.run.smithi017:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-17T02:21:36.256 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 7cbfae20-b10d-41da-92b7-cbd5c1632e23... 2024-04-17T02:21:36.257 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-17T02:21:36.299 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-17T02:21:36.349 INFO:teuthology.orchestra.run.smithi017.stdout:[global] 2024-04-17T02:21:36.350 INFO:teuthology.orchestra.run.smithi017.stdout: chdir = "" 2024-04-17T02:21:36.350 INFO:teuthology.orchestra.run.smithi017.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-17T02:21:36.350 INFO:teuthology.orchestra.run.smithi017.stdout: auth supported = cephx 2024-04-17T02:21:36.350 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:36.350 INFO:teuthology.orchestra.run.smithi017.stdout: filestore xattr use omap = true 2024-04-17T02:21:36.350 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:36.350 INFO:teuthology.orchestra.run.smithi017.stdout: mon clock drift allowed = 1.000 2024-04-17T02:21:36.350 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:36.350 INFO:teuthology.orchestra.run.smithi017.stdout: osd crush chooseleaf type = 0 2024-04-17T02:21:36.350 INFO:teuthology.orchestra.run.smithi017.stdout: auth debug = true 2024-04-17T02:21:36.350 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:36.351 INFO:teuthology.orchestra.run.smithi017.stdout: ms die on old message = true 2024-04-17T02:21:36.351 INFO:teuthology.orchestra.run.smithi017.stdout: ms die on bug = true 2024-04-17T02:21:36.351 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:36.351 INFO:teuthology.orchestra.run.smithi017.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-17T02:21:36.351 INFO:teuthology.orchestra.run.smithi017.stdout: mon pg warn max object skew = 0 2024-04-17T02:21:36.351 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:36.351 INFO:teuthology.orchestra.run.smithi017.stdout: # disable pg_autoscaler by default for new pools 2024-04-17T02:21:36.351 INFO:teuthology.orchestra.run.smithi017.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-17T02:21:36.351 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:36.351 INFO:teuthology.orchestra.run.smithi017.stdout: osd pool default size = 2 2024-04-17T02:21:36.351 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:36.351 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd allow primary affinity = true 2024-04-17T02:21:36.352 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd allow pg remap = true 2024-04-17T02:21:36.352 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on legacy crush tunables = false 2024-04-17T02:21:36.352 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on crush straw calc version zero = false 2024-04-17T02:21:36.352 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on no sortbitwise = false 2024-04-17T02:21:36.352 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on osd down out interval zero = false 2024-04-17T02:21:36.352 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on too few osds = false 2024-04-17T02:21:36.352 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-17T02:21:36.352 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-17T02:21:36.352 INFO:teuthology.orchestra.run.smithi017.stdout: mon_allow_pool_size_one = true 2024-04-17T02:21:36.352 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:36.352 INFO:teuthology.orchestra.run.smithi017.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-17T02:21:36.352 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:36.353 INFO:teuthology.orchestra.run.smithi017.stdout: osd default data pool replay window = 5 2024-04-17T02:21:36.353 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:36.353 INFO:teuthology.orchestra.run.smithi017.stdout: mon allow pool delete = true 2024-04-17T02:21:36.353 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:36.353 INFO:teuthology.orchestra.run.smithi017.stdout: mon cluster log file level = debug 2024-04-17T02:21:36.353 INFO:teuthology.orchestra.run.smithi017.stdout: debug asserts on shutdown = true 2024-04-17T02:21:36.353 INFO:teuthology.orchestra.run.smithi017.stdout: mon health detail to clog = false 2024-04-17T02:21:36.353 INFO:teuthology.orchestra.run.smithi017.stdout: mon host = "172.21.15.17,[v2:172.21.15.17:3301,v1:172.21.15.17:6790],172.21.15.122" 2024-04-17T02:21:36.353 INFO:teuthology.orchestra.run.smithi017.stdout: mon election default strategy = 3 2024-04-17T02:21:36.353 INFO:teuthology.orchestra.run.smithi017.stdout: fsid = 7cbfae20-b10d-41da-92b7-cbd5c1632e23 2024-04-17T02:21:36.353 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:36.353 INFO:teuthology.orchestra.run.smithi017.stdout:[osd] 2024-04-17T02:21:36.353 INFO:teuthology.orchestra.run.smithi017.stdout: osd journal size = 100 2024-04-17T02:21:36.354 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:36.354 INFO:teuthology.orchestra.run.smithi017.stdout: osd scrub load threshold = 5.0 2024-04-17T02:21:36.354 INFO:teuthology.orchestra.run.smithi017.stdout: osd scrub max interval = 600 2024-04-17T02:21:36.354 INFO:teuthology.orchestra.run.smithi017.stdout: osd mclock profile = high_recovery_ops 2024-04-17T02:21:36.354 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:36.354 INFO:teuthology.orchestra.run.smithi017.stdout: osd recover clone overlap = true 2024-04-17T02:21:36.354 INFO:teuthology.orchestra.run.smithi017.stdout: osd recovery max chunk = 1048576 2024-04-17T02:21:36.354 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:36.354 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug shutdown = true 2024-04-17T02:21:36.354 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug op order = true 2024-04-17T02:21:36.354 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug verify stray on activate = true 2024-04-17T02:21:36.354 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug trim objects = true 2024-04-17T02:21:36.354 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:36.355 INFO:teuthology.orchestra.run.smithi017.stdout: osd open classes on start = true 2024-04-17T02:21:36.355 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug pg log writeout = true 2024-04-17T02:21:36.355 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:36.355 INFO:teuthology.orchestra.run.smithi017.stdout: osd deep scrub update digest min age = 30 2024-04-17T02:21:36.355 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:36.355 INFO:teuthology.orchestra.run.smithi017.stdout: osd map max advance = 10 2024-04-17T02:21:36.355 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:36.355 INFO:teuthology.orchestra.run.smithi017.stdout: journal zero on create = true 2024-04-17T02:21:36.355 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:36.355 INFO:teuthology.orchestra.run.smithi017.stdout: filestore ondisk finisher threads = 3 2024-04-17T02:21:36.355 INFO:teuthology.orchestra.run.smithi017.stdout: filestore apply finisher threads = 3 2024-04-17T02:21:36.355 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:36.355 INFO:teuthology.orchestra.run.smithi017.stdout: bdev debug aio = true 2024-04-17T02:21:36.356 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug misdirected ops = true 2024-04-17T02:21:36.356 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore block size = 96636764160 2024-04-17T02:21:36.356 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore compression algorithm = snappy 2024-04-17T02:21:36.356 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore compression mode = aggressive 2024-04-17T02:21:36.356 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore fsck on mount = True 2024-04-17T02:21:36.356 INFO:teuthology.orchestra.run.smithi017.stdout: debug bluefs = 20 2024-04-17T02:21:36.356 INFO:teuthology.orchestra.run.smithi017.stdout: debug bluestore = 20 2024-04-17T02:21:36.356 INFO:teuthology.orchestra.run.smithi017.stdout: debug mgrc = 20 2024-04-17T02:21:36.356 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-04-17T02:21:36.356 INFO:teuthology.orchestra.run.smithi017.stdout: debug osd = 20 2024-04-17T02:21:36.356 INFO:teuthology.orchestra.run.smithi017.stdout: debug rocksdb = 10 2024-04-17T02:21:36.356 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd backfillfull_ratio = 0.85 2024-04-17T02:21:36.356 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd full ratio = 0.9 2024-04-17T02:21:36.357 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd nearfull ratio = 0.8 2024-04-17T02:21:36.357 INFO:teuthology.orchestra.run.smithi017.stdout: osd failsafe full ratio = 0.95 2024-04-17T02:21:36.357 INFO:teuthology.orchestra.run.smithi017.stdout: osd objectstore = bluestore 2024-04-17T02:21:36.357 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:36.357 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr] 2024-04-17T02:21:36.357 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-04-17T02:21:36.357 INFO:teuthology.orchestra.run.smithi017.stdout: debug mgr = 20 2024-04-17T02:21:36.357 INFO:teuthology.orchestra.run.smithi017.stdout: debug mon = 20 2024-04-17T02:21:36.357 INFO:teuthology.orchestra.run.smithi017.stdout: debug auth = 20 2024-04-17T02:21:36.357 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min pgs per osd = 4 2024-04-17T02:21:36.357 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min bytes per osd = 10 2024-04-17T02:21:36.357 INFO:teuthology.orchestra.run.smithi017.stdout: mgr/telemetry/nag = false 2024-04-17T02:21:36.357 INFO:teuthology.orchestra.run.smithi017.stdout: debug client = 20 2024-04-17T02:21:36.358 INFO:teuthology.orchestra.run.smithi017.stdout: mgr ttl cache expire seconds = 5 2024-04-17T02:21:36.358 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:36.358 INFO:teuthology.orchestra.run.smithi017.stdout:[mon] 2024-04-17T02:21:36.358 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-04-17T02:21:36.358 INFO:teuthology.orchestra.run.smithi017.stdout: debug mon = 20 2024-04-17T02:21:36.358 INFO:teuthology.orchestra.run.smithi017.stdout: debug paxos = 20 2024-04-17T02:21:36.358 INFO:teuthology.orchestra.run.smithi017.stdout: debug auth = 20 2024-04-17T02:21:36.358 INFO:teuthology.orchestra.run.smithi017.stdout: mon data avail warn = 5 2024-04-17T02:21:36.358 INFO:teuthology.orchestra.run.smithi017.stdout: mon mgr mkfs grace = 240 2024-04-17T02:21:36.358 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min pgs per osd = 4 2024-04-17T02:21:36.358 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd reporter subtree level = osd 2024-04-17T02:21:36.358 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd prime pg temp = true 2024-04-17T02:21:36.359 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min bytes per osd = 10 2024-04-17T02:21:36.359 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:36.359 INFO:teuthology.orchestra.run.smithi017.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-17T02:21:36.359 INFO:teuthology.orchestra.run.smithi017.stdout: auth mon ticket ttl = 660 # 11m 2024-04-17T02:21:36.359 INFO:teuthology.orchestra.run.smithi017.stdout: auth service ticket ttl = 240 # 4m 2024-04-17T02:21:36.359 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:36.359 INFO:teuthology.orchestra.run.smithi017.stdout: # don't complain about insecure global_id in the test suite 2024-04-17T02:21:36.359 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-17T02:21:36.359 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-17T02:21:36.359 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:36.359 INFO:teuthology.orchestra.run.smithi017.stdout: # 1m isn't quite enough 2024-04-17T02:21:36.359 INFO:teuthology.orchestra.run.smithi017.stdout: mon_down_mkfs_grace = 2m 2024-04-17T02:21:36.359 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:36.360 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_filestore_osds = false 2024-04-17T02:21:36.360 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:21:36.360 INFO:teuthology.orchestra.run.smithi017.stdout:[client] 2024-04-17T02:21:36.360 INFO:teuthology.orchestra.run.smithi017.stdout: rgw cache enabled = true 2024-04-17T02:21:36.360 INFO:teuthology.orchestra.run.smithi017.stdout: rgw enable ops log = true 2024-04-17T02:21:36.360 INFO:teuthology.orchestra.run.smithi017.stdout: rgw enable usage log = true 2024-04-17T02:21:36.360 INFO:teuthology.orchestra.run.smithi017.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-17T02:21:36.360 INFO:teuthology.orchestra.run.smithi017.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-17T02:21:36.360 INFO:teuthology.orchestra.run.smithi017.stdout: debug client = 20 2024-04-17T02:21:36.360 INFO:teuthology.orchestra.run.smithi017.stdout: debug mgrc = 20 2024-04-17T02:21:36.360 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-04-17T02:21:36.360 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.a] 2024-04-17T02:21:36.360 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.c] 2024-04-17T02:21:36.361 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.b] 2024-04-17T02:21:36.361 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.a] 2024-04-17T02:21:36.361 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.c] 2024-04-17T02:21:36.361 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.b] 2024-04-17T02:21:36.361 INFO:teuthology.orchestra.run.smithi017.stdout:[mds] 2024-04-17T02:21:36.361 INFO:teuthology.orchestra.run.smithi017.stdout: debug mgrc = 20 2024-04-17T02:21:36.361 INFO:teuthology.orchestra.run.smithi122.stdout:[global] 2024-04-17T02:21:36.362 INFO:teuthology.orchestra.run.smithi122.stdout: chdir = "" 2024-04-17T02:21:36.362 INFO:teuthology.orchestra.run.smithi122.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-17T02:21:36.362 INFO:teuthology.orchestra.run.smithi122.stdout: auth supported = cephx 2024-04-17T02:21:36.362 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:36.362 INFO:teuthology.orchestra.run.smithi122.stdout: filestore xattr use omap = true 2024-04-17T02:21:36.362 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:36.362 INFO:teuthology.orchestra.run.smithi122.stdout: mon clock drift allowed = 1.000 2024-04-17T02:21:36.362 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:36.362 INFO:teuthology.orchestra.run.smithi122.stdout: osd crush chooseleaf type = 0 2024-04-17T02:21:36.362 INFO:teuthology.orchestra.run.smithi122.stdout: auth debug = true 2024-04-17T02:21:36.362 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:36.363 INFO:teuthology.orchestra.run.smithi122.stdout: ms die on old message = true 2024-04-17T02:21:36.363 INFO:teuthology.orchestra.run.smithi122.stdout: ms die on bug = true 2024-04-17T02:21:36.363 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:36.363 INFO:teuthology.orchestra.run.smithi122.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-17T02:21:36.363 INFO:teuthology.orchestra.run.smithi122.stdout: mon pg warn max object skew = 0 2024-04-17T02:21:36.363 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:36.363 INFO:teuthology.orchestra.run.smithi122.stdout: # disable pg_autoscaler by default for new pools 2024-04-17T02:21:36.363 INFO:teuthology.orchestra.run.smithi122.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-17T02:21:36.363 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:36.363 INFO:teuthology.orchestra.run.smithi122.stdout: osd pool default size = 2 2024-04-17T02:21:36.363 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:36.363 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd allow primary affinity = true 2024-04-17T02:21:36.364 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd allow pg remap = true 2024-04-17T02:21:36.364 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on legacy crush tunables = false 2024-04-17T02:21:36.364 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on crush straw calc version zero = false 2024-04-17T02:21:36.364 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on no sortbitwise = false 2024-04-17T02:21:36.364 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on osd down out interval zero = false 2024-04-17T02:21:36.364 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on too few osds = false 2024-04-17T02:21:36.364 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-17T02:21:36.364 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-17T02:21:36.364 INFO:teuthology.orchestra.run.smithi122.stdout: mon_allow_pool_size_one = true 2024-04-17T02:21:36.364 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:36.364 INFO:teuthology.orchestra.run.smithi122.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-17T02:21:36.364 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:36.365 INFO:teuthology.orchestra.run.smithi122.stdout: osd default data pool replay window = 5 2024-04-17T02:21:36.365 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:36.365 INFO:teuthology.orchestra.run.smithi122.stdout: mon allow pool delete = true 2024-04-17T02:21:36.365 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:36.365 INFO:teuthology.orchestra.run.smithi122.stdout: mon cluster log file level = debug 2024-04-17T02:21:36.365 INFO:teuthology.orchestra.run.smithi122.stdout: debug asserts on shutdown = true 2024-04-17T02:21:36.365 INFO:teuthology.orchestra.run.smithi122.stdout: mon health detail to clog = false 2024-04-17T02:21:36.365 INFO:teuthology.orchestra.run.smithi122.stdout: mon host = "172.21.15.17,[v2:172.21.15.17:3301,v1:172.21.15.17:6790],172.21.15.122" 2024-04-17T02:21:36.365 INFO:teuthology.orchestra.run.smithi122.stdout: mon election default strategy = 3 2024-04-17T02:21:36.365 INFO:teuthology.orchestra.run.smithi122.stdout: fsid = 7cbfae20-b10d-41da-92b7-cbd5c1632e23 2024-04-17T02:21:36.365 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:36.365 INFO:teuthology.orchestra.run.smithi122.stdout:[osd] 2024-04-17T02:21:36.365 INFO:teuthology.orchestra.run.smithi122.stdout: osd journal size = 100 2024-04-17T02:21:36.366 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:36.366 INFO:teuthology.orchestra.run.smithi122.stdout: osd scrub load threshold = 5.0 2024-04-17T02:21:36.366 INFO:teuthology.orchestra.run.smithi122.stdout: osd scrub max interval = 600 2024-04-17T02:21:36.366 INFO:teuthology.orchestra.run.smithi122.stdout: osd mclock profile = high_recovery_ops 2024-04-17T02:21:36.366 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:36.366 INFO:teuthology.orchestra.run.smithi122.stdout: osd recover clone overlap = true 2024-04-17T02:21:36.366 INFO:teuthology.orchestra.run.smithi122.stdout: osd recovery max chunk = 1048576 2024-04-17T02:21:36.366 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:36.366 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug shutdown = true 2024-04-17T02:21:36.366 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug op order = true 2024-04-17T02:21:36.366 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug verify stray on activate = true 2024-04-17T02:21:36.366 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug trim objects = true 2024-04-17T02:21:36.367 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:36.367 INFO:teuthology.orchestra.run.smithi122.stdout: osd open classes on start = true 2024-04-17T02:21:36.367 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug pg log writeout = true 2024-04-17T02:21:36.367 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:36.367 INFO:teuthology.orchestra.run.smithi122.stdout: osd deep scrub update digest min age = 30 2024-04-17T02:21:36.367 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:36.367 INFO:teuthology.orchestra.run.smithi122.stdout: osd map max advance = 10 2024-04-17T02:21:36.367 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:36.367 INFO:teuthology.orchestra.run.smithi122.stdout: journal zero on create = true 2024-04-17T02:21:36.367 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:36.367 INFO:teuthology.orchestra.run.smithi122.stdout: filestore ondisk finisher threads = 3 2024-04-17T02:21:36.367 INFO:teuthology.orchestra.run.smithi122.stdout: filestore apply finisher threads = 3 2024-04-17T02:21:36.367 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:36.368 INFO:teuthology.orchestra.run.smithi122.stdout: bdev debug aio = true 2024-04-17T02:21:36.368 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug misdirected ops = true 2024-04-17T02:21:36.368 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore block size = 96636764160 2024-04-17T02:21:36.368 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore compression algorithm = snappy 2024-04-17T02:21:36.368 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore compression mode = aggressive 2024-04-17T02:21:36.368 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore fsck on mount = True 2024-04-17T02:21:36.368 INFO:teuthology.orchestra.run.smithi122.stdout: debug bluefs = 20 2024-04-17T02:21:36.368 INFO:teuthology.orchestra.run.smithi122.stdout: debug bluestore = 20 2024-04-17T02:21:36.368 INFO:teuthology.orchestra.run.smithi122.stdout: debug mgrc = 20 2024-04-17T02:21:36.368 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2024-04-17T02:21:36.368 INFO:teuthology.orchestra.run.smithi122.stdout: debug osd = 20 2024-04-17T02:21:36.368 INFO:teuthology.orchestra.run.smithi122.stdout: debug rocksdb = 10 2024-04-17T02:21:36.368 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd backfillfull_ratio = 0.85 2024-04-17T02:21:36.368 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd full ratio = 0.9 2024-04-17T02:21:36.369 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd nearfull ratio = 0.8 2024-04-17T02:21:36.369 INFO:teuthology.orchestra.run.smithi122.stdout: osd failsafe full ratio = 0.95 2024-04-17T02:21:36.369 INFO:teuthology.orchestra.run.smithi122.stdout: osd objectstore = bluestore 2024-04-17T02:21:36.369 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:36.369 INFO:teuthology.orchestra.run.smithi122.stdout:[mgr] 2024-04-17T02:21:36.369 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2024-04-17T02:21:36.369 INFO:teuthology.orchestra.run.smithi122.stdout: debug mgr = 20 2024-04-17T02:21:36.369 INFO:teuthology.orchestra.run.smithi122.stdout: debug mon = 20 2024-04-17T02:21:36.369 INFO:teuthology.orchestra.run.smithi122.stdout: debug auth = 20 2024-04-17T02:21:36.369 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min pgs per osd = 4 2024-04-17T02:21:36.369 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min bytes per osd = 10 2024-04-17T02:21:36.369 INFO:teuthology.orchestra.run.smithi122.stdout: mgr/telemetry/nag = false 2024-04-17T02:21:36.369 INFO:teuthology.orchestra.run.smithi122.stdout: debug client = 20 2024-04-17T02:21:36.370 INFO:teuthology.orchestra.run.smithi122.stdout: mgr ttl cache expire seconds = 5 2024-04-17T02:21:36.370 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:36.370 INFO:teuthology.orchestra.run.smithi122.stdout:[mon] 2024-04-17T02:21:36.370 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2024-04-17T02:21:36.370 INFO:teuthology.orchestra.run.smithi122.stdout: debug mon = 20 2024-04-17T02:21:36.370 INFO:teuthology.orchestra.run.smithi122.stdout: debug paxos = 20 2024-04-17T02:21:36.370 INFO:teuthology.orchestra.run.smithi122.stdout: debug auth = 20 2024-04-17T02:21:36.370 INFO:teuthology.orchestra.run.smithi122.stdout: mon data avail warn = 5 2024-04-17T02:21:36.370 INFO:teuthology.orchestra.run.smithi122.stdout: mon mgr mkfs grace = 240 2024-04-17T02:21:36.370 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min pgs per osd = 4 2024-04-17T02:21:36.370 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd reporter subtree level = osd 2024-04-17T02:21:36.370 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd prime pg temp = true 2024-04-17T02:21:36.371 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min bytes per osd = 10 2024-04-17T02:21:36.371 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:36.371 INFO:teuthology.orchestra.run.smithi122.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-17T02:21:36.371 INFO:teuthology.orchestra.run.smithi122.stdout: auth mon ticket ttl = 660 # 11m 2024-04-17T02:21:36.371 INFO:teuthology.orchestra.run.smithi122.stdout: auth service ticket ttl = 240 # 4m 2024-04-17T02:21:36.371 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:36.371 INFO:teuthology.orchestra.run.smithi122.stdout: # don't complain about insecure global_id in the test suite 2024-04-17T02:21:36.371 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-17T02:21:36.371 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-17T02:21:36.371 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:36.371 INFO:teuthology.orchestra.run.smithi122.stdout: # 1m isn't quite enough 2024-04-17T02:21:36.371 INFO:teuthology.orchestra.run.smithi122.stdout: mon_down_mkfs_grace = 2m 2024-04-17T02:21:36.371 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:36.372 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_filestore_osds = false 2024-04-17T02:21:36.372 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-17T02:21:36.372 INFO:teuthology.orchestra.run.smithi122.stdout:[client] 2024-04-17T02:21:36.372 INFO:teuthology.orchestra.run.smithi122.stdout: rgw cache enabled = true 2024-04-17T02:21:36.372 INFO:teuthology.orchestra.run.smithi122.stdout: rgw enable ops log = true 2024-04-17T02:21:36.372 INFO:teuthology.orchestra.run.smithi122.stdout: rgw enable usage log = true 2024-04-17T02:21:36.372 INFO:teuthology.orchestra.run.smithi122.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-17T02:21:36.372 INFO:teuthology.orchestra.run.smithi122.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-17T02:21:36.372 INFO:teuthology.orchestra.run.smithi122.stdout: debug client = 20 2024-04-17T02:21:36.372 INFO:teuthology.orchestra.run.smithi122.stdout: debug mgrc = 20 2024-04-17T02:21:36.372 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2024-04-17T02:21:36.372 INFO:teuthology.orchestra.run.smithi122.stdout:[mon.a] 2024-04-17T02:21:36.372 INFO:teuthology.orchestra.run.smithi122.stdout:[mon.c] 2024-04-17T02:21:36.372 INFO:teuthology.orchestra.run.smithi122.stdout:[mon.b] 2024-04-17T02:21:36.373 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.a] 2024-04-17T02:21:36.373 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.c] 2024-04-17T02:21:36.373 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.b] 2024-04-17T02:21:36.373 INFO:teuthology.orchestra.run.smithi122.stdout:[mds] 2024-04-17T02:21:36.373 INFO:teuthology.orchestra.run.smithi122.stdout: debug mgrc = 20 2024-04-17T02:21:36.374 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-17T02:21:36.375 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-17T02:21:36.472 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-17T02:21:36.472 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-04-17T02:21:36.472 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-17T02:21:36.487 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-04-17T02:21:36.487 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-17T02:21:36.542 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi017.front.sepia.ceph.com 2024-04-17T02:21:36.543 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-04-17T02:21:36.543 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-17T02:21:36.543 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-17T02:21:36.623 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-04-17T02:21:36.623 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-17T02:21:36.679 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi122.front.sepia.ceph.com 2024-04-17T02:21:36.679 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-17T02:21:36.679 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-17T02:21:36.679 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-17T02:21:36.721 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-17T02:21:36.721 DEBUG:teuthology.orchestra.run.smithi122:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-17T02:21:36.776 INFO:tasks.ceph:Setting up mon nodes... 2024-04-17T02:21:36.776 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-17T02:21:36.777 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-17T02:21:36.834 INFO:teuthology.orchestra.run.smithi017.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-17T02:21:36.836 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-17T02:21:36.902 INFO:teuthology.orchestra.run.smithi122.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-17T02:21:36.905 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/mgr/ceph-z && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.z /var/lib/ceph/mgr/ceph-z/keyring 2024-04-17T02:21:36.962 INFO:teuthology.orchestra.run.smithi122.stdout:creating /var/lib/ceph/mgr/ceph-z/keyring 2024-04-17T02:21:36.964 INFO:tasks.ceph:Setting up mds nodes... 2024-04-17T02:21:36.964 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-17T02:21:37.022 INFO:teuthology.orchestra.run.smithi017.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-17T02:21:37.024 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-17T02:21:37.052 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-17T02:21:37.150 INFO:teuthology.orchestra.run.smithi017.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-17T02:21:37.152 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-17T02:21:37.180 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-17T02:21:37.237 INFO:teuthology.orchestra.run.smithi122.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-17T02:21:37.239 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-17T02:21:37.267 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-17T02:21:37.267 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-17T02:21:37.311 INFO:teuthology.orchestra.run.smithi017.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-17T02:21:37.327 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-17T02:21:37.370 INFO:teuthology.orchestra.run.smithi122.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-17T02:21:37.386 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-17T02:21:37.386 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi017.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi122.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-04-17T02:21:37.387 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-17T02:21:37.415 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-17T02:21:37.415 INFO:tasks.ceph:role: osd.0 2024-04-17T02:21:37.415 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi017.front.sepia.ceph.com 2024-04-17T02:21:37.415 DEBUG:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-17T02:21:37.482 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T02:21:37.482 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T02:21:37.482 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T02:21:37.482 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-17T02:21:37.483 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T02:21:37.483 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2024-04-17T02:21:37.483 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T02:21:37.483 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-17T02:21:37.483 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T02:21:37.483 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T02:21:37.515 INFO:teuthology.orchestra.run.smithi017.stdout:Discarding blocks...Done. 2024-04-17T02:21:37.517 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2024-04-17T02:21:37.517 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-17T02:21:37.588 DEBUG:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-17T02:21:37.664 DEBUG:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T02:21:37.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:37.769+0000 7feff080d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-17T02:21:37.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:37.769+0000 7feff080d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-17T02:21:37.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:37.769+0000 7feff080d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-17T02:21:37.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:37.769+0000 7feff080d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-17T02:21:37.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:37.769+0000 7feff080d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-17T02:21:37.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:37.770+0000 7feff080d640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-17T02:21:40.635 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-17T02:21:40.669 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-17T02:21:40.703 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-17T02:21:40.703 INFO:tasks.ceph:role: osd.1 2024-04-17T02:21:40.703 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi122.front.sepia.ceph.com 2024-04-17T02:21:40.703 DEBUG:teuthology.orchestra.run.smithi122:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-17T02:21:40.784 INFO:teuthology.orchestra.run.smithi122.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T02:21:40.785 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T02:21:40.785 INFO:teuthology.orchestra.run.smithi122.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T02:21:40.785 INFO:teuthology.orchestra.run.smithi122.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-17T02:21:40.785 INFO:teuthology.orchestra.run.smithi122.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T02:21:40.785 INFO:teuthology.orchestra.run.smithi122.stdout: = sunit=0 swidth=0 blks 2024-04-17T02:21:40.785 INFO:teuthology.orchestra.run.smithi122.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T02:21:40.785 INFO:teuthology.orchestra.run.smithi122.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-17T02:21:40.785 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T02:21:40.785 INFO:teuthology.orchestra.run.smithi122.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T02:21:41.244 INFO:teuthology.orchestra.run.smithi122.stdout:Discarding blocks...Done. 2024-04-17T02:21:41.247 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi122.front.sepia.ceph.com -o noatime 2024-04-17T02:21:41.247 DEBUG:teuthology.orchestra.run.smithi122:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-17T02:21:41.375 DEBUG:teuthology.orchestra.run.smithi122:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-17T02:21:41.416 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-17T02:21:41.488 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-17T02:21:41.488 INFO:tasks.ceph:role: osd.2 2024-04-17T02:21:41.488 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi122.front.sepia.ceph.com 2024-04-17T02:21:41.488 DEBUG:teuthology.orchestra.run.smithi122:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-17T02:21:41.567 INFO:teuthology.orchestra.run.smithi122.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T02:21:41.567 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T02:21:41.567 INFO:teuthology.orchestra.run.smithi122.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T02:21:41.567 INFO:teuthology.orchestra.run.smithi122.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-17T02:21:41.567 INFO:teuthology.orchestra.run.smithi122.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T02:21:41.567 INFO:teuthology.orchestra.run.smithi122.stdout: = sunit=0 swidth=0 blks 2024-04-17T02:21:41.567 INFO:teuthology.orchestra.run.smithi122.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T02:21:41.567 INFO:teuthology.orchestra.run.smithi122.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-17T02:21:41.567 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T02:21:41.567 INFO:teuthology.orchestra.run.smithi122.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T02:21:42.018 INFO:teuthology.orchestra.run.smithi122.stdout:Discarding blocks...Done. 2024-04-17T02:21:42.020 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi122.front.sepia.ceph.com -o noatime 2024-04-17T02:21:42.020 DEBUG:teuthology.orchestra.run.smithi122:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-04-17T02:21:42.116 DEBUG:teuthology.orchestra.run.smithi122:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-17T02:21:42.149 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-17T02:21:42.218 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-17T02:21:42.218 INFO:tasks.ceph:role: osd.3 2024-04-17T02:21:42.218 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi122.front.sepia.ceph.com 2024-04-17T02:21:42.218 DEBUG:teuthology.orchestra.run.smithi122:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-17T02:21:42.294 INFO:teuthology.orchestra.run.smithi122.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T02:21:42.294 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T02:21:42.294 INFO:teuthology.orchestra.run.smithi122.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T02:21:42.295 INFO:teuthology.orchestra.run.smithi122.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-17T02:21:42.295 INFO:teuthology.orchestra.run.smithi122.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T02:21:42.295 INFO:teuthology.orchestra.run.smithi122.stdout: = sunit=0 swidth=0 blks 2024-04-17T02:21:42.295 INFO:teuthology.orchestra.run.smithi122.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T02:21:42.295 INFO:teuthology.orchestra.run.smithi122.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-17T02:21:42.295 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T02:21:42.295 INFO:teuthology.orchestra.run.smithi122.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T02:21:42.774 INFO:teuthology.orchestra.run.smithi122.stdout:Discarding blocks...Done. 2024-04-17T02:21:42.776 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi122.front.sepia.ceph.com -o noatime 2024-04-17T02:21:42.776 DEBUG:teuthology.orchestra.run.smithi122:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-04-17T02:21:42.878 DEBUG:teuthology.orchestra.run.smithi122:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-17T02:21:42.912 DEBUG:teuthology.orchestra.run.smithi122:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T02:21:43.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:21:43.012+0000 7f17868d5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-17T02:21:43.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:21:43.015+0000 7f17868d5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-17T02:21:43.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:21:43.015+0000 7f17868d5640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-17T02:21:43.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:21:43.015+0000 7f17868d5640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-17T02:21:43.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:21:43.015+0000 7f17868d5640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-17T02:21:43.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:21:43.019+0000 7f17868d5640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-17T02:21:45.881 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-17T02:21:45.915 DEBUG:teuthology.orchestra.run.smithi122:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T02:21:46.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:21:46.012+0000 7f2e4ae68640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-17T02:21:46.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:21:46.012+0000 7f2e4ae68640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-17T02:21:46.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:21:46.012+0000 7f2e4ae68640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-17T02:21:46.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:21:46.012+0000 7f2e4ae68640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-17T02:21:46.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:21:46.012+0000 7f2e4ae68640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-17T02:21:46.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:21:46.013+0000 7f2e4ae68640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-17T02:21:48.872 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-17T02:21:48.907 DEBUG:teuthology.orchestra.run.smithi122:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T02:21:49.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:21:49.003+0000 7f5dcaa13640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-17T02:21:49.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:21:49.003+0000 7f5dcaa13640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-17T02:21:49.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:21:49.003+0000 7f5dcaa13640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-17T02:21:49.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:21:49.003+0000 7f5dcaa13640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-17T02:21:49.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:21:49.003+0000 7f5dcaa13640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-17T02:21:49.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:21:49.004+0000 7f5dcaa13640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-17T02:21:51.855 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-17T02:21:51.889 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-17T02:21:51.889 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-04-17T02:21:51.889 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-17T02:21:51.924 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-04-17T02:21:51.924 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-17T02:21:51.996 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-04-17T02:21:51.996 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-17T02:21:52.067 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-04-17T02:21:52.067 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-17T02:21:52.137 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-17T02:21:52.137 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-17T02:21:52.171 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-17T02:21:52.171 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/mgr/ceph-z/keyring of=/dev/stdout 2024-04-17T02:21:52.244 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-17T02:21:52.245 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-17T02:21:52.315 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-17T02:21:52.315 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-17T02:21:52.385 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-17T02:21:52.385 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-17T02:21:52.455 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-17T02:21:52.455 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-17T02:21:52.524 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-04-17T02:21:52.524 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-17T02:21:52.542 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-17T02:21:52.542 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-17T02:21:52.580 INFO:tasks.ceph:Adding keys to all mons... 2024-04-17T02:21:52.580 DEBUG:teuthology.orchestra.run.smithi017:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-17T02:21:52.585 DEBUG:teuthology.orchestra.run.smithi122:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-17T02:21:52.624 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr.x] 2024-04-17T02:21:52.624 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQAwMh9m7Ua9MRAA8Pm+2TECo8c5H4omJcodBw== 2024-04-17T02:21:52.624 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.a] 2024-04-17T02:21:52.624 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQAxMh9mN/hVARAAfMTyWh67dDZKuorT82UMAg== 2024-04-17T02:21:52.624 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.c] 2024-04-17T02:21:52.624 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQAxMh9mMff3CBAAwU0oTCn+gbtTVA0BiJIaPA== 2024-04-17T02:21:52.624 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.0] 2024-04-17T02:21:52.624 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQAxMh9mwiT8LRAAtDtNQLWq+oHVgR/DGNGzYg== 2024-04-17T02:21:52.624 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr.y] 2024-04-17T02:21:52.625 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQAwMh9m4F3RNRAAUY1sV1JG6aHqxCTQsAtkXw== 2024-04-17T02:21:52.625 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr.z] 2024-04-17T02:21:52.625 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQAwMh9maNZdORAAH5sBFLIew2nZoS1Cc35fOQ== 2024-04-17T02:21:52.625 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.b] 2024-04-17T02:21:52.625 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQAxMh9mMnwrDhAAJ/ny/Djh3oXK1cE2LhVdrg== 2024-04-17T02:21:52.625 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.1] 2024-04-17T02:21:52.625 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQA3Mh9mbEHKABAAQahKA/NBPkT+ZyC8Le9ebw== 2024-04-17T02:21:52.625 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.2] 2024-04-17T02:21:52.625 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQA6Mh9mDqbHABAAV3x+k5C8DwLSF5TVHVR+zw== 2024-04-17T02:21:52.625 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.3] 2024-04-17T02:21:52.625 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQA9Mh9m1yFBABAAnPM/z8pt7groFpu/sWKC9Q== 2024-04-17T02:21:52.625 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2024-04-17T02:21:52.625 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQAxMh9mLayQEhAAz4DsIJsoLX71BcGtE1x8mw== 2024-04-17T02:21:52.625 INFO:teuthology.orchestra.run.smithi017.stdout:[client.1] 2024-04-17T02:21:52.626 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQAxMh9mmagZFhAAqV4Fsxjjj95E2BQs26Sb/g== 2024-04-17T02:21:52.647 INFO:teuthology.orchestra.run.smithi122.stdout:[mgr.x] 2024-04-17T02:21:52.647 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQAwMh9m7Ua9MRAA8Pm+2TECo8c5H4omJcodBw== 2024-04-17T02:21:52.647 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.a] 2024-04-17T02:21:52.647 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQAxMh9mN/hVARAAfMTyWh67dDZKuorT82UMAg== 2024-04-17T02:21:52.647 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.c] 2024-04-17T02:21:52.647 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQAxMh9mMff3CBAAwU0oTCn+gbtTVA0BiJIaPA== 2024-04-17T02:21:52.648 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.0] 2024-04-17T02:21:52.648 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQAxMh9mwiT8LRAAtDtNQLWq+oHVgR/DGNGzYg== 2024-04-17T02:21:52.648 INFO:teuthology.orchestra.run.smithi122.stdout:[mgr.y] 2024-04-17T02:21:52.648 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQAwMh9m4F3RNRAAUY1sV1JG6aHqxCTQsAtkXw== 2024-04-17T02:21:52.648 INFO:teuthology.orchestra.run.smithi122.stdout:[mgr.z] 2024-04-17T02:21:52.648 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQAwMh9maNZdORAAH5sBFLIew2nZoS1Cc35fOQ== 2024-04-17T02:21:52.648 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.b] 2024-04-17T02:21:52.648 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQAxMh9mMnwrDhAAJ/ny/Djh3oXK1cE2LhVdrg== 2024-04-17T02:21:52.648 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.1] 2024-04-17T02:21:52.648 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQA3Mh9mbEHKABAAQahKA/NBPkT+ZyC8Le9ebw== 2024-04-17T02:21:52.648 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.2] 2024-04-17T02:21:52.648 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQA6Mh9mDqbHABAAV3x+k5C8DwLSF5TVHVR+zw== 2024-04-17T02:21:52.648 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.3] 2024-04-17T02:21:52.648 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQA9Mh9m1yFBABAAnPM/z8pt7groFpu/sWKC9Q== 2024-04-17T02:21:52.648 INFO:teuthology.orchestra.run.smithi122.stdout:[client.0] 2024-04-17T02:21:52.648 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQAxMh9mLayQEhAAz4DsIJsoLX71BcGtE1x8mw== 2024-04-17T02:21:52.649 INFO:teuthology.orchestra.run.smithi122.stdout:[client.1] 2024-04-17T02:21:52.649 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQAxMh9mmagZFhAAqV4Fsxjjj95E2BQs26Sb/g== 2024-04-17T02:21:52.649 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-17T02:21:52.669 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-17T02:21:52.744 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T02:21:52.746 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T02:21:52.805 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T02:21:52.808 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T02:21:52.865 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T02:21:52.867 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T02:21:52.922 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-17T02:21:52.924 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-17T02:21:52.978 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-17T02:21:52.980 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-17T02:21:53.034 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T02:21:53.036 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T02:21:53.092 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T02:21:53.095 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T02:21:53.148 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T02:21:53.150 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T02:21:53.204 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T02:21:53.206 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T02:21:53.260 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-17T02:21:53.262 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-17T02:21:53.319 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-17T02:21:53.321 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-17T02:21:53.377 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-17T02:21:53.377 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-17T02:21:53.405 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-17T02:21:53.503 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-17T02:21:53.533 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-17T02:21:53.599 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-17T02:21:53.698 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-17T02:21:53.726 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-17T02:21:53.755 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-17T02:21:53.857 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-17T02:21:53.886 DEBUG:teuthology.orchestra.run.smithi017:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-17T02:21:53.888 DEBUG:teuthology.orchestra.run.smithi122:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-17T02:21:53.942 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-17T02:21:53.942 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-17T02:21:53.943 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-17T02:21:53.945 INFO:tasks.ceph.mon.a:Started 2024-04-17T02:21:53.945 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-17T02:21:53.945 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-17T02:21:53.947 INFO:tasks.ceph.mon.c:Started 2024-04-17T02:21:53.947 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-17T02:21:53.947 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-17T02:21:53.985 INFO:tasks.ceph.mon.b:Started 2024-04-17T02:21:53.985 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-17T02:21:53.986 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-17T02:21:53.986 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-17T02:21:53.988 INFO:tasks.ceph.mgr.x:Started 2024-04-17T02:21:53.988 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-17T02:21:53.988 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-17T02:21:53.990 INFO:tasks.ceph.mgr.y:Started 2024-04-17T02:21:53.990 INFO:tasks.ceph.mgr.z:Restarting daemon 2024-04-17T02:21:53.991 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i z 2024-04-17T02:21:53.992 INFO:tasks.ceph.mgr.z:Started 2024-04-17T02:21:53.993 INFO:tasks.ceph:Setting crush tunables to default 2024-04-17T02:21:53.993 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph osd crush tunables default 2024-04-17T02:21:54.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.098+0000 7f7d1cb88640 1 Processor -- start 2024-04-17T02:21:54.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.098+0000 7f7d1cb88640 1 -- start start 2024-04-17T02:21:54.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.099+0000 7f7d1cb88640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7d180a6080 0x7f7d180a71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:21:54.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.099+0000 7f7d1cb88640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7d1814b640 0x7f7d1814da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:21:54.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.099+0000 7f7d1cb88640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d18072540 con 0x7f7d180a59c0 2024-04-17T02:21:54.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.099+0000 7f7d1cb88640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f7d18072800 con 0x7f7d180a6080 2024-04-17T02:21:54.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.099+0000 7f7d1cb88640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f7d18071e90 con 0x7f7d1814b640 2024-04-17T02:21:54.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.099+0000 7f7d1659c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7d180a6080 0x7f7d180a71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:21:54.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.099+0000 7f7d1659c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7d180a6080 0x7f7d180a71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54894/0 (socket says 172.21.15.17:54894) 2024-04-17T02:21:54.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.099+0000 7f7d1659c640 1 -- 172.21.15.17:0/3267189162 learned_addr learned my addr 172.21.15.17:0/3267189162 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:21:54.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.099+0000 7f7d1659c640 1 -- 172.21.15.17:0/3267189162 >> v2:172.21.15.17:3300/0 conn(0x7f7d180a6080 msgr2=0x7f7d180a71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T02:21:54.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.099+0000 7f7d1659c640 1 -- 172.21.15.17:0/3267189162 >> v2:172.21.15.17:3300/0 conn(0x7f7d180a6080 msgr2=0x7f7d180a71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T02:21:54.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.099+0000 7f7d1659c640 1 --2- 172.21.15.17:0/3267189162 >> v2:172.21.15.17:3300/0 conn(0x7f7d180a6080 0x7f7d180a71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T02:21:54.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.099+0000 7f7d1659c640 1 --2- 172.21.15.17:0/3267189162 >> v2:172.21.15.17:3300/0 conn(0x7f7d180a6080 0x7f7d180a71d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T02:21:54.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.099+0000 7f7d16d9d640 1 --2- 172.21.15.17:0/3267189162 >> v2:172.21.15.122:3300/0 conn(0x7f7d1814b640 0x7f7d1814da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:21:54.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.099+0000 7f7d16d9d640 1 -- 172.21.15.17:0/3267189162 >> v2:172.21.15.122:3300/0 conn(0x7f7d1814b640 msgr2=0x7f7d1814da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-17T02:21:54.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.099+0000 7f7d16d9d640 1 -- 172.21.15.17:0/3267189162 >> v2:172.21.15.122:3300/0 conn(0x7f7d1814b640 msgr2=0x7f7d1814da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T02:21:54.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.099+0000 7f7d16d9d640 1 --2- 172.21.15.17:0/3267189162 >> v2:172.21.15.122:3300/0 conn(0x7f7d1814b640 0x7f7d1814da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T02:21:54.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.099+0000 7f7d16d9d640 1 --2- 172.21.15.17:0/3267189162 >> v2:172.21.15.122:3300/0 conn(0x7f7d1814b640 0x7f7d1814da30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T02:21:54.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.300+0000 7f7d1659c640 1 --2- 172.21.15.17:0/3267189162 >> v2:172.21.15.17:3300/0 conn(0x7f7d180a6080 0x7f7d180a71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:21:54.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.300+0000 7f7d1659c640 1 -- 172.21.15.17:0/3267189162 >> v2:172.21.15.17:3300/0 conn(0x7f7d180a6080 msgr2=0x7f7d180a71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T02:21:54.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.300+0000 7f7d1659c640 1 -- 172.21.15.17:0/3267189162 >> v2:172.21.15.17:3300/0 conn(0x7f7d180a6080 msgr2=0x7f7d180a71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T02:21:54.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.300+0000 7f7d1659c640 1 --2- 172.21.15.17:0/3267189162 >> v2:172.21.15.17:3300/0 conn(0x7f7d180a6080 0x7f7d180a71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T02:21:54.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.300+0000 7f7d1659c640 1 --2- 172.21.15.17:0/3267189162 >> v2:172.21.15.17:3300/0 conn(0x7f7d180a6080 0x7f7d180a71d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T02:21:54.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.300+0000 7f7d16d9d640 1 --2- 172.21.15.17:0/3267189162 >> v2:172.21.15.122:3300/0 conn(0x7f7d1814b640 0x7f7d1814da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:21:54.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.300+0000 7f7d16d9d640 1 -- 172.21.15.17:0/3267189162 >> v2:172.21.15.122:3300/0 conn(0x7f7d1814b640 msgr2=0x7f7d1814da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-17T02:21:54.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.300+0000 7f7d16d9d640 1 -- 172.21.15.17:0/3267189162 >> v2:172.21.15.122:3300/0 conn(0x7f7d1814b640 msgr2=0x7f7d1814da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T02:21:54.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.300+0000 7f7d16d9d640 1 --2- 172.21.15.17:0/3267189162 >> v2:172.21.15.122:3300/0 conn(0x7f7d1814b640 0x7f7d1814da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T02:21:54.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.300+0000 7f7d16d9d640 1 --2- 172.21.15.17:0/3267189162 >> v2:172.21.15.122:3300/0 conn(0x7f7d1814b640 0x7f7d1814da30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T02:21:54.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.701+0000 7f7d1659c640 1 --2- 172.21.15.17:0/3267189162 >> v2:172.21.15.17:3300/0 conn(0x7f7d180a6080 0x7f7d180a71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:21:54.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.701+0000 7f7d1659c640 1 -- 172.21.15.17:0/3267189162 >> v2:172.21.15.17:3300/0 conn(0x7f7d180a6080 msgr2=0x7f7d180a71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-17T02:21:54.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.701+0000 7f7d1659c640 1 -- 172.21.15.17:0/3267189162 >> v2:172.21.15.17:3300/0 conn(0x7f7d180a6080 msgr2=0x7f7d180a71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T02:21:54.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.701+0000 7f7d1659c640 1 --2- 172.21.15.17:0/3267189162 >> v2:172.21.15.17:3300/0 conn(0x7f7d180a6080 0x7f7d180a71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T02:21:54.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.701+0000 7f7d1659c640 1 --2- 172.21.15.17:0/3267189162 >> v2:172.21.15.17:3300/0 conn(0x7f7d180a6080 0x7f7d180a71d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T02:21:54.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.701+0000 7f7d16d9d640 1 --2- 172.21.15.17:0/3267189162 >> v2:172.21.15.122:3300/0 conn(0x7f7d1814b640 0x7f7d1814da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:21:54.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.701+0000 7f7d16d9d640 1 -- 172.21.15.17:0/3267189162 >> v2:172.21.15.122:3300/0 conn(0x7f7d1814b640 msgr2=0x7f7d1814da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T02:21:54.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.701+0000 7f7d16d9d640 1 -- 172.21.15.17:0/3267189162 >> v2:172.21.15.122:3300/0 conn(0x7f7d1814b640 msgr2=0x7f7d1814da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T02:21:54.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.701+0000 7f7d16d9d640 1 --2- 172.21.15.17:0/3267189162 >> v2:172.21.15.122:3300/0 conn(0x7f7d1814b640 0x7f7d1814da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T02:21:54.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:54.701+0000 7f7d16d9d640 1 --2- 172.21.15.17:0/3267189162 >> v2:172.21.15.122:3300/0 conn(0x7f7d1814b640 0x7f7d1814da30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T02:21:55.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:55.502+0000 7f7d1659c640 1 --2- 172.21.15.17:0/3267189162 >> v2:172.21.15.17:3300/0 conn(0x7f7d180a6080 0x7f7d180a71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:21:55.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:55.502+0000 7f7d1659c640 1 -- 172.21.15.17:0/3267189162 >> v2:172.21.15.17:3300/0 conn(0x7f7d180a6080 msgr2=0x7f7d180a71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T02:21:55.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:55.502+0000 7f7d1659c640 1 -- 172.21.15.17:0/3267189162 >> v2:172.21.15.17:3300/0 conn(0x7f7d180a6080 msgr2=0x7f7d180a71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T02:21:55.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:55.502+0000 7f7d1659c640 1 --2- 172.21.15.17:0/3267189162 >> v2:172.21.15.17:3300/0 conn(0x7f7d180a6080 0x7f7d180a71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T02:21:55.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:55.502+0000 7f7d1659c640 1 --2- 172.21.15.17:0/3267189162 >> v2:172.21.15.17:3300/0 conn(0x7f7d180a6080 0x7f7d180a71d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-17T02:21:55.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:55.502+0000 7f7d16d9d640 1 --2- 172.21.15.17:0/3267189162 >> v2:172.21.15.122:3300/0 conn(0x7f7d1814b640 0x7f7d1814da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:21:55.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:55.502+0000 7f7d16d9d640 1 -- 172.21.15.17:0/3267189162 >> v2:172.21.15.122:3300/0 conn(0x7f7d1814b640 msgr2=0x7f7d1814da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-17T02:21:55.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:55.502+0000 7f7d16d9d640 1 -- 172.21.15.17:0/3267189162 >> v2:172.21.15.122:3300/0 conn(0x7f7d1814b640 msgr2=0x7f7d1814da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T02:21:55.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:55.502+0000 7f7d16d9d640 1 --2- 172.21.15.17:0/3267189162 >> v2:172.21.15.122:3300/0 conn(0x7f7d1814b640 0x7f7d1814da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T02:21:55.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:55.502+0000 7f7d16d9d640 1 --2- 172.21.15.17:0/3267189162 >> v2:172.21.15.122:3300/0 conn(0x7f7d1814b640 0x7f7d1814da30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-17T02:21:57.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:57.099+0000 7f7d14d99640 1 -- 172.21.15.17:0/3267189162 >> v2:172.21.15.122:3300/0 conn(0x7f7d1814b640 msgr2=0x7f7d1814da30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T02:21:57.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:57.099+0000 7f7d14d99640 1 --2- 172.21.15.17:0/3267189162 >> v2:172.21.15.122:3300/0 conn(0x7f7d1814b640 0x7f7d1814da30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:21:57.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:57.099+0000 7f7d14d99640 1 -- 172.21.15.17:0/3267189162 >> v2:172.21.15.17:3300/0 conn(0x7f7d180a6080 msgr2=0x7f7d180a71d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T02:21:57.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:57.099+0000 7f7d14d99640 1 --2- 172.21.15.17:0/3267189162 >> v2:172.21.15.17:3300/0 conn(0x7f7d180a6080 0x7f7d180a71d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:21:57.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:57.099+0000 7f7d14d99640 1 -- 172.21.15.17:0/3267189162 >> v1:172.21.15.122:6789/0 conn(0x7f7d180a59c0 legacy=0x7f7d18143720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:21:57.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:57.099+0000 7f7d14d99640 1 --2- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cf8003690 0x7f7cf8005ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:21:57.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:57.099+0000 7f7d14d99640 1 -- 172.21.15.17:0/3267189162 --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d180aad20 con 0x7f7cf80061f0 2024-04-17T02:21:57.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:57.099+0000 7f7d14d99640 1 -- 172.21.15.17:0/3267189162 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f7d18072800 con 0x7f7cf8003690 2024-04-17T02:21:57.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:57.099+0000 7f7d1659c640 1 --2- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cf8003690 0x7f7cf8005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:21:57.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:57.099+0000 7f7d1659c640 1 -- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cf8003690 msgr2=0x7f7cf8005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T02:21:57.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:57.099+0000 7f7d1659c640 1 -- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cf8003690 msgr2=0x7f7cf8005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T02:21:57.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:57.099+0000 7f7d1659c640 1 --2- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cf8003690 0x7f7cf8005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T02:21:57.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:57.099+0000 7f7d1659c640 1 --2- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cf8003690 0x7f7cf8005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T02:21:57.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:57.300+0000 7f7d1659c640 1 --2- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cf8003690 0x7f7cf8005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:21:57.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:57.300+0000 7f7d1659c640 1 -- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cf8003690 msgr2=0x7f7cf8005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T02:21:57.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:57.300+0000 7f7d1659c640 1 -- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cf8003690 msgr2=0x7f7cf8005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T02:21:57.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:57.300+0000 7f7d1659c640 1 --2- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cf8003690 0x7f7cf8005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T02:21:57.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:57.300+0000 7f7d1659c640 1 --2- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cf8003690 0x7f7cf8005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T02:21:57.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:57.701+0000 7f7d1659c640 1 --2- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cf8003690 0x7f7cf8005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:21:57.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:57.701+0000 7f7d1659c640 1 -- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cf8003690 msgr2=0x7f7cf8005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T02:21:57.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:57.701+0000 7f7d1659c640 1 -- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cf8003690 msgr2=0x7f7cf8005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T02:21:57.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:57.701+0000 7f7d1659c640 1 --2- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cf8003690 0x7f7cf8005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T02:21:57.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:57.701+0000 7f7d1659c640 1 --2- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cf8003690 0x7f7cf8005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T02:21:58.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:58.502+0000 7f7d1659c640 1 --2- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cf8003690 0x7f7cf8005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:21:58.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:58.502+0000 7f7d1659c640 1 -- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cf8003690 msgr2=0x7f7cf8005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T02:21:58.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:58.502+0000 7f7d1659c640 1 -- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cf8003690 msgr2=0x7f7cf8005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T02:21:58.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:58.502+0000 7f7d1659c640 1 --2- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cf8003690 0x7f7cf8005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T02:21:58.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:21:58.502+0000 7f7d1659c640 1 --2- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cf8003690 0x7f7cf8005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-17T02:22:00.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.099+0000 7f7d14d99640 1 -- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cf8003690 msgr2=0x7f7cf8005ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T02:22:00.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.099+0000 7f7d14d99640 1 --2- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cf8003690 0x7f7cf8005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:00.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.099+0000 7f7d14d99640 1 -- 172.21.15.17:0/3267189162 >> v1:172.21.15.17:6789/0 conn(0x7f7cf80061f0 legacy=0x7f7cf8008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:00.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.099+0000 7f7d16d9d640 1 -- 172.21.15.17:0/3267189162 reap_dead start 2024-04-17T02:22:00.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.099+0000 7f7d14d99640 1 --2- 172.21.15.17:0/3267189162 >> v2:172.21.15.122:3300/0 conn(0x7f7d1814b640 0x7f7cf800a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:00.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.099+0000 7f7d14d99640 1 --2- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cf8005b60 0x7f7cf800a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:00.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.099+0000 7f7d14d99640 1 -- 172.21.15.17:0/3267189162 --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cf800b030 con 0x7f7cf800a5b0 2024-04-17T02:22:00.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.099+0000 7f7d14d99640 1 -- 172.21.15.17:0/3267189162 --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f7d18072800 con 0x7f7d1814b640 2024-04-17T02:22:00.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.099+0000 7f7d14d99640 1 -- 172.21.15.17:0/3267189162 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f7d18071e90 con 0x7f7cf8005b60 2024-04-17T02:22:00.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.100+0000 7f7d16d9d640 1 --2- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cf8005b60 0x7f7cf800a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:00.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.100+0000 7f7d1659c640 1 --2- 172.21.15.17:0/3267189162 >> v2:172.21.15.122:3300/0 conn(0x7f7d1814b640 0x7f7cf800a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:00.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.100+0000 7f7d16d9d640 1 -- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cf8005b60 msgr2=0x7f7cf800a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-17T02:22:00.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.100+0000 7f7d16d9d640 1 -- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cf8005b60 msgr2=0x7f7cf800a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T02:22:00.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.100+0000 7f7d16d9d640 1 --2- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cf8005b60 0x7f7cf800a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T02:22:00.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.100+0000 7f7d16d9d640 1 --2- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cf8005b60 0x7f7cf800a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T02:22:00.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.100+0000 7f7d1659c640 1 -- 172.21.15.17:0/3267189162 >> v2:172.21.15.122:3300/0 conn(0x7f7d1814b640 msgr2=0x7f7cf800a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T02:22:00.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.100+0000 7f7d1659c640 1 -- 172.21.15.17:0/3267189162 >> v2:172.21.15.122:3300/0 conn(0x7f7d1814b640 msgr2=0x7f7cf800a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T02:22:00.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.100+0000 7f7d1659c640 1 --2- 172.21.15.17:0/3267189162 >> v2:172.21.15.122:3300/0 conn(0x7f7d1814b640 0x7f7cf800a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T02:22:00.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.100+0000 7f7d1659c640 1 --2- 172.21.15.17:0/3267189162 >> v2:172.21.15.122:3300/0 conn(0x7f7d1814b640 0x7f7cf800a070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T02:22:00.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.263+0000 7f7d15d9b640 1 -- 172.21.15.17:0/3267189162 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2258069594 0 0) 0x7f7cf800b030 con 0x7f7cf800a5b0 2024-04-17T02:22:00.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.263+0000 7f7d15d9b640 1 -- 172.21.15.17:0/3267189162 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d04003520 con 0x7f7cf800a5b0 2024-04-17T02:22:00.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.269+0000 7f7d15d9b640 1 -- 172.21.15.17:0/3267189162 <== mon.1 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3084144573 0 0) 0x7f7d04003520 con 0x7f7cf800a5b0 2024-04-17T02:22:00.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.269+0000 7f7d15d9b640 1 -- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cf8005b60 msgr2=0x7f7cf800a990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T02:22:00.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.269+0000 7f7d15d9b640 1 --2- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cf8005b60 0x7f7cf800a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:00.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.269+0000 7f7d15d9b640 1 -- 172.21.15.17:0/3267189162 >> v2:172.21.15.122:3300/0 conn(0x7f7d1814b640 msgr2=0x7f7cf800a070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T02:22:00.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.269+0000 7f7d15d9b640 1 --2- 172.21.15.17:0/3267189162 >> v2:172.21.15.122:3300/0 conn(0x7f7d1814b640 0x7f7cf800a070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:00.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.269+0000 7f7d15d9b640 1 -- 172.21.15.17:0/3267189162 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf8008770 con 0x7f7cf800a5b0 2024-04-17T02:22:00.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.269+0000 7f7d15d9b640 1 -- 172.21.15.17:0/3267189162 <== mon.1 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1752030744 0 0) 0x7f7d000016b0 con 0x7f7cf800a5b0 2024-04-17T02:22:00.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.269+0000 7f7d15d9b640 1 -- 172.21.15.17:0/3267189162 >> v1:172.21.15.122:6789/0 conn(0x7f7cf800a5b0 legacy=0x7f7cf8008e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:00.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.269+0000 7f7d15d9b640 1 --2- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cf8005b60 0x7f7d040039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:00.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.269+0000 7f7d15d9b640 1 --2- 172.21.15.17:0/3267189162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d04003fe0 0x7f7d04004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:00.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.269+0000 7f7d15d9b640 1 --2- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d04004d40 0x7f7d040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:00.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.269+0000 7f7d15d9b640 1 -- 172.21.15.17:0/3267189162 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7d18072800 con 0x7f7d04004d40 2024-04-17T02:22:00.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.269+0000 7f7d15d9b640 1 -- 172.21.15.17:0/3267189162 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7d18071e90 con 0x7f7d04003fe0 2024-04-17T02:22:00.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.269+0000 7f7d15d9b640 1 -- 172.21.15.17:0/3267189162 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f7d0400bbd0 con 0x7f7cf8005b60 2024-04-17T02:22:00.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.269+0000 7f7d1659c640 1 --2- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cf8005b60 0x7f7d040039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:00.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.269+0000 7f7d0ffff640 1 --2- 172.21.15.17:0/3267189162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d04003fe0 0x7f7d04004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:00.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.269+0000 7f7d16d9d640 1 --2- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d04004d40 0x7f7d040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:00.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.270+0000 7f7d1659c640 1 -- 172.21.15.17:0/3267189162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d04003fe0 msgr2=0x7f7d04004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:00.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.270+0000 7f7d1659c640 1 --2- 172.21.15.17:0/3267189162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d04003fe0 0x7f7d04004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:00.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.270+0000 7f7d1659c640 1 -- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d04004d40 msgr2=0x7f7d040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:00.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.270+0000 7f7d1659c640 1 --2- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d04004d40 0x7f7d040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:00.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.270+0000 7f7d1659c640 1 -- 172.21.15.17:0/3267189162 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d04003520 con 0x7f7cf8005b60 2024-04-17T02:22:00.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.271+0000 7f7d1659c640 1 --2- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cf8005b60 0x7f7d040039b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7d0801ab60 tx=0x7f7d04005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cdb21aef996b606 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:00.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.272+0000 7f7d15d9b640 1 -- 172.21.15.17:0/3267189162 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d08035070 con 0x7f7cf8005b60 2024-04-17T02:22:00.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.272+0000 7f7d15d9b640 1 -- 172.21.15.17:0/3267189162 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d0802f460 con 0x7f7cf8005b60 2024-04-17T02:22:00.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.272+0000 7f7d15d9b640 1 -- 172.21.15.17:0/3267189162 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d0800f040 con 0x7f7cf8005b60 2024-04-17T02:22:00.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.273+0000 7f7d1cb88640 1 -- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cf8005b60 msgr2=0x7f7d040039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:00.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.273+0000 7f7d1cb88640 1 --2- 172.21.15.17:0/3267189162 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cf8005b60 0x7f7d040039b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7d0801ab60 tx=0x7f7d04005830 comp rx=0 tx=0).stop 2024-04-17T02:22:00.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.273+0000 7f7d16d9d640 1 -- 172.21.15.17:0/3267189162 reap_dead start 2024-04-17T02:22:00.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.273+0000 7f7d1cb88640 1 -- 172.21.15.17:0/3267189162 shutdown_connections 2024-04-17T02:22:00.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.273+0000 7f7d1cb88640 1 -- 172.21.15.17:0/3267189162 >> 172.21.15.17:0/3267189162 conn(0x7f7d18073fc0 msgr2=0x7f7d180743d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:00.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.273+0000 7f7d1cb88640 1 -- 172.21.15.17:0/3267189162 shutdown_connections 2024-04-17T02:22:00.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.273+0000 7f7d1cb88640 1 -- 172.21.15.17:0/3267189162 wait complete. 2024-04-17T02:22:00.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.275+0000 7f7d1cb88640 1 Processor -- start 2024-04-17T02:22:00.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.275+0000 7f7d1cb88640 1 -- start start 2024-04-17T02:22:00.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.275+0000 7f7d1cb88640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cf8005b60 0x7f7d180a3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:00.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.275+0000 7f7d1cb88640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7d18146180 0x7f7d181465c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:00.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.275+0000 7f7d1cb88640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d181d9930 0x7f7d181d9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:00.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.275+0000 7f7d1cb88640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7d180b8df0 con 0x7f7cf8005b60 2024-04-17T02:22:00.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.275+0000 7f7d1cb88640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7d180a8f30 con 0x7f7d181d9930 2024-04-17T02:22:00.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.275+0000 7f7d1cb88640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f7d180b8f70 con 0x7f7d18146180 2024-04-17T02:22:00.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.275+0000 7f7d1659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cf8005b60 0x7f7d180a3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:00.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.275+0000 7f7d0ffff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7d18146180 0x7f7d181465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:00.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.275+0000 7f7d1659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cf8005b60 0x7f7d180a3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55000/0 (socket says 172.21.15.17:55000) 2024-04-17T02:22:00.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.276+0000 7f7d0ffff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7d18146180 0x7f7d181465c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:56268/0 (socket says 172.21.15.17:56268) 2024-04-17T02:22:00.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.276+0000 7f7d1659c640 1 -- 172.21.15.17:0/4110111840 learned_addr learned my addr 172.21.15.17:0/4110111840 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:00.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.276+0000 7f7d16d9d640 1 --2- 172.21.15.17:0/4110111840 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d181d9930 0x7f7d181d9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:00.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.276+0000 7f7d0ffff640 1 -- 172.21.15.17:0/4110111840 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d181d9930 msgr2=0x7f7d181d9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:00.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.276+0000 7f7d0ffff640 1 --2- 172.21.15.17:0/4110111840 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d181d9930 0x7f7d181d9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:00.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.276+0000 7f7d0ffff640 1 -- 172.21.15.17:0/4110111840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cf8005b60 msgr2=0x7f7d180a3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:00.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.276+0000 7f7d0ffff640 1 --2- 172.21.15.17:0/4110111840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cf8005b60 0x7f7d180a3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:00.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.276+0000 7f7d0ffff640 1 -- 172.21.15.17:0/4110111840 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d180a3950 con 0x7f7d18146180 2024-04-17T02:22:00.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.276+0000 7f7d16d9d640 1 --2- 172.21.15.17:0/4110111840 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d181d9930 0x7f7d181d9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:00.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.276+0000 7f7d1659c640 1 --2- 172.21.15.17:0/4110111840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cf8005b60 0x7f7d180a3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:00.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.276+0000 7f7d0ffff640 1 --2- 172.21.15.17:0/4110111840 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7d18146180 0x7f7d181465c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7d0000ca20 tx=0x7f7d0000cee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:00.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.276+0000 7f7d0effd640 1 -- 172.21.15.17:0/4110111840 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d000137a0 con 0x7f7d18146180 2024-04-17T02:22:00.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.276+0000 7f7d0effd640 1 -- 172.21.15.17:0/4110111840 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d00013940 con 0x7f7d18146180 2024-04-17T02:22:00.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.276+0000 7f7d1cb88640 1 -- 172.21.15.17:0/4110111840 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d180a3c10 con 0x7f7d18146180 2024-04-17T02:22:00.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.276+0000 7f7d0effd640 1 -- 172.21.15.17:0/4110111840 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d00013d30 con 0x7f7d18146180 2024-04-17T02:22:00.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.277+0000 7f7d1cb88640 1 -- 172.21.15.17:0/4110111840 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d1813ec20 con 0x7f7d18146180 2024-04-17T02:22:00.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.277+0000 7f7d0effd640 1 -- 172.21.15.17:0/4110111840 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7d000035f0 con 0x7f7d18146180 2024-04-17T02:22:00.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.277+0000 7f7d0effd640 20 mgrc handle_mgr_map mgrmap(e 1) 2024-04-17T02:22:00.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.277+0000 7f7d0effd640 4 mgrc handle_mgr_map Got map version 1 2024-04-17T02:22:00.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.277+0000 7f7d0effd640 4 mgrc handle_mgr_map Active mgr is now 2024-04-17T02:22:00.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.277+0000 7f7d0effd640 4 mgrc reconnect No active mgr available yet 2024-04-17T02:22:00.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.277+0000 7f7d0effd640 1 -- 172.21.15.17:0/4110111840 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7d0001a8d0 con 0x7f7d18146180 2024-04-17T02:22:00.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.278+0000 7f7d1cb88640 1 -- 172.21.15.17:0/4110111840 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d18067f80 con 0x7f7d18146180 2024-04-17T02:22:00.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.280+0000 7f7d0effd640 1 -- 172.21.15.17:0/4110111840 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f7d0001a430 con 0x7f7d18146180 2024-04-17T02:22:00.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.349+0000 7f7d1cb88640 1 -- 172.21.15.17:0/4110111840 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f7d18067f80 con 0x7f7d18146180 2024-04-17T02:22:00.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.352+0000 7f7d0effd640 1 -- 172.21.15.17:0/4110111840 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f7d0001ab20 con 0x7f7d18146180 2024-04-17T02:22:00.353 INFO:teuthology.orchestra.run.smithi017.stderr:adjusted tunables profile to default 2024-04-17T02:22:00.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.353+0000 7f7d1cb88640 10 mgrc shutdown 2024-04-17T02:22:00.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.353+0000 7f7d1cb88640 1 -- 172.21.15.17:0/4110111840 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7d18146180 msgr2=0x7f7d181465c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:00.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.353+0000 7f7d1cb88640 1 --2- 172.21.15.17:0/4110111840 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7d18146180 0x7f7d181465c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7d0000ca20 tx=0x7f7d0000cee0 comp rx=0 tx=0).stop 2024-04-17T02:22:00.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.353+0000 7f7d1cb88640 1 -- 172.21.15.17:0/4110111840 shutdown_connections 2024-04-17T02:22:00.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.353+0000 7f7d1cb88640 1 --2- 172.21.15.17:0/4110111840 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d181d9930 0x7f7d181d9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:00.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.354+0000 7f7d1cb88640 1 --2- 172.21.15.17:0/4110111840 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7d18146180 0x7f7d181465c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:00.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.354+0000 7f7d1cb88640 1 --2- 172.21.15.17:0/4110111840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cf8005b60 0x7f7d180a3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:00.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.354+0000 7f7d1cb88640 1 -- 172.21.15.17:0/4110111840 >> 172.21.15.17:0/4110111840 conn(0x7f7d18073fc0 msgr2=0x7f7d180a95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:00.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.354+0000 7f7d1cb88640 1 -- 172.21.15.17:0/4110111840 shutdown_connections 2024-04-17T02:22:00.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:00.354+0000 7f7d1cb88640 1 -- 172.21.15.17:0/4110111840 wait complete. 2024-04-17T02:22:00.366 INFO:tasks.ceph:check_enable_crimson: False 2024-04-17T02:22:00.366 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-17T02:22:00.366 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-04-17T02:22:00.366 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-17T02:22:00.395 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-17T02:22:00.395 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-17T02:22:00.431 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-17T02:22:00.431 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-17T02:22:00.506 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-17T02:22:00.506 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-17T02:22:00.577 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd new 2973665c-6c5e-4688-bffe-72d3bdcf467f 0 2024-04-17T02:22:00.721 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.720+0000 7f0190352640 1 Processor -- start 2024-04-17T02:22:00.722 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.720+0000 7f0190352640 1 -- start start 2024-04-17T02:22:00.724 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.722+0000 7f0190352640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f0188143a20 0x7f01880a8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:00.724 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.722+0000 7f0190352640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f01880733d0 0x7f01880a5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:00.724 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.722+0000 7f0190352640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01880a7360 con 0x7f01880a60e0 2024-04-17T02:22:00.724 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.722+0000 7f0190352640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f01880a7620 con 0x7f01880733d0 2024-04-17T02:22:00.724 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.722+0000 7f0190352640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f01880a7080 con 0x7f0188143a20 2024-04-17T02:22:00.724 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.722+0000 7f018e0ee640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f0188143a20 0x7f01880a8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:00.724 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.722+0000 7f018e0ee640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f0188143a20 0x7f01880a8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:42712/0 (socket says 172.21.15.122:42712) 2024-04-17T02:22:00.724 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.722+0000 7f018e8ef640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f01880a60e0 0x7f018806e420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:40412/0 (socket says 172.21.15.122:40412) 2024-04-17T02:22:00.724 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.722+0000 7f018e0ee640 1 -- 172.21.15.122:0/2114486741 learned_addr learned my addr 172.21.15.122:0/2114486741 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-04-17T02:22:00.724 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.722+0000 7f018d8ed640 1 --2- 172.21.15.122:0/2114486741 >> v2:172.21.15.17:3300/0 conn(0x7f01880733d0 0x7f01880a5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:00.724 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.722+0000 7f018e0ee640 1 -- 172.21.15.122:0/2114486741 >> v2:172.21.15.17:3300/0 conn(0x7f01880733d0 msgr2=0x7f01880a5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:00.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.722+0000 7f018e0ee640 1 --2- 172.21.15.122:0/2114486741 >> v2:172.21.15.17:3300/0 conn(0x7f01880733d0 0x7f01880a5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:00.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.722+0000 7f018e0ee640 1 -- 172.21.15.122:0/2114486741 >> v1:172.21.15.122:6789/0 conn(0x7f01880a60e0 legacy=0x7f018806e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:00.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.722+0000 7f018e0ee640 1 -- 172.21.15.122:0/2114486741 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0188143e00 con 0x7f0188143a20 2024-04-17T02:22:00.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.722+0000 7f018d8ed640 1 --2- 172.21.15.122:0/2114486741 >> v2:172.21.15.17:3300/0 conn(0x7f01880733d0 0x7f01880a5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T02:22:00.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.723+0000 7f018e0ee640 1 --2- 172.21.15.122:0/2114486741 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0188143a20 0x7f01880a8260 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f01880a5680 tx=0x7f018402b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=255d501e0cf92c4c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:00.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.723+0000 7f018d0ec640 1 -- 172.21.15.122:0/2114486741 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018402e070 con 0x7f0188143a20 2024-04-17T02:22:00.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.723+0000 7f018d0ec640 1 -- 172.21.15.122:0/2114486741 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0184037070 con 0x7f0188143a20 2024-04-17T02:22:00.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.723+0000 7f018d0ec640 1 -- 172.21.15.122:0/2114486741 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0184031a00 con 0x7f0188143a20 2024-04-17T02:22:00.726 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.724+0000 7f0190352640 1 -- 172.21.15.122:0/2114486741 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0188143a20 msgr2=0x7f01880a8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:00.726 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.724+0000 7f0190352640 1 --2- 172.21.15.122:0/2114486741 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0188143a20 0x7f01880a8260 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f01880a5680 tx=0x7f018402b880 comp rx=0 tx=0).stop 2024-04-17T02:22:00.726 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.724+0000 7f0190352640 1 -- 172.21.15.122:0/2114486741 shutdown_connections 2024-04-17T02:22:00.726 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.724+0000 7f0190352640 1 --2- 172.21.15.122:0/2114486741 >> v2:172.21.15.17:3300/0 conn(0x7f01880733d0 0x7f01880a5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:00.726 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.724+0000 7f0190352640 1 --2- 172.21.15.122:0/2114486741 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0188143a20 0x7f01880a8260 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:00.726 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.724+0000 7f0190352640 1 -- 172.21.15.122:0/2114486741 >> 172.21.15.122:0/2114486741 conn(0x7f01880746a0 msgr2=0x7f01880a7ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:00.726 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.724+0000 7f0190352640 1 -- 172.21.15.122:0/2114486741 shutdown_connections 2024-04-17T02:22:00.726 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.724+0000 7f0190352640 1 -- 172.21.15.122:0/2114486741 wait complete. 2024-04-17T02:22:00.727 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.726+0000 7f0190352640 1 Processor -- start 2024-04-17T02:22:00.727 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.726+0000 7f0190352640 1 -- start start 2024-04-17T02:22:00.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.727+0000 7f0190352640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01880733d0 0x7f01880adc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:00.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.727+0000 7f0190352640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f01880a60e0 0x7f01881cf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:00.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.727+0000 7f0190352640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0188143a20 0x7f018813e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:00.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.727+0000 7f0190352640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0188072c70 con 0x7f01880733d0 2024-04-17T02:22:00.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.727+0000 7f0190352640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0188072af0 con 0x7f0188143a20 2024-04-17T02:22:00.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.727+0000 7f0190352640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f01880aaf00 con 0x7f01880a60e0 2024-04-17T02:22:00.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.727+0000 7f018e8ef640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0188143a20 0x7f018813e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:00.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.727+0000 7f018e8ef640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0188143a20 0x7f018813e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:42720/0 (socket says 172.21.15.122:42720) 2024-04-17T02:22:00.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.727+0000 7f018e8ef640 1 -- 172.21.15.122:0/752966931 learned_addr learned my addr 172.21.15.122:0/752966931 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-04-17T02:22:00.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.727+0000 7f018e0ee640 1 --2- 172.21.15.122:0/752966931 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01880733d0 0x7f01880adc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:00.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.727+0000 7f018d8ed640 1 --2- 172.21.15.122:0/752966931 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f01880a60e0 0x7f01881cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:00.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.727+0000 7f018e8ef640 1 -- 172.21.15.122:0/752966931 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f01880a60e0 msgr2=0x7f01881cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:00.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.727+0000 7f018e8ef640 1 --2- 172.21.15.122:0/752966931 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f01880a60e0 0x7f01881cf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:00.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.727+0000 7f018e8ef640 1 -- 172.21.15.122:0/752966931 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01880733d0 msgr2=0x7f01880adc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:00.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.727+0000 7f018e8ef640 1 --2- 172.21.15.122:0/752966931 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01880733d0 0x7f01880adc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:00.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.727+0000 7f018e8ef640 1 -- 172.21.15.122:0/752966931 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01881ce8b0 con 0x7f0188143a20 2024-04-17T02:22:00.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.727+0000 7f018e8ef640 1 --2- 172.21.15.122:0/752966931 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0188143a20 0x7f018813e530 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f018000c780 tx=0x7f018000cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:00.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.727+0000 7f017effd640 1 -- 172.21.15.122:0/752966931 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0180017070 con 0x7f0188143a20 2024-04-17T02:22:00.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.727+0000 7f017effd640 1 -- 172.21.15.122:0/752966931 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f018000a640 con 0x7f0188143a20 2024-04-17T02:22:00.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.727+0000 7f0190352640 1 -- 172.21.15.122:0/752966931 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01881cfbe0 con 0x7f0188143a20 2024-04-17T02:22:00.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.727+0000 7f017effd640 1 -- 172.21.15.122:0/752966931 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018000aa30 con 0x7f0188143a20 2024-04-17T02:22:00.732 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.728+0000 7f0190352640 1 -- 172.21.15.122:0/752966931 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01880ac0b0 con 0x7f0188143a20 2024-04-17T02:22:00.732 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.728+0000 7f017effd640 1 -- 172.21.15.122:0/752966931 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f018001a070 con 0x7f0188143a20 2024-04-17T02:22:00.732 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.728+0000 7f017effd640 20 mgrc handle_mgr_map mgrmap(e 1) 2024-04-17T02:22:00.732 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.728+0000 7f017effd640 4 mgrc handle_mgr_map Got map version 1 2024-04-17T02:22:00.732 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.728+0000 7f017effd640 4 mgrc handle_mgr_map Active mgr is now 2024-04-17T02:22:00.732 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.728+0000 7f017effd640 4 mgrc reconnect No active mgr available yet 2024-04-17T02:22:00.732 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.728+0000 7f017effd640 1 -- 172.21.15.122:0/752966931 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f018001c780 con 0x7f0188143a20 2024-04-17T02:22:00.732 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.728+0000 7f0190352640 1 -- 172.21.15.122:0/752966931 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01880aa580 con 0x7f0188143a20 2024-04-17T02:22:00.732 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.731+0000 7f017effd640 1 -- 172.21.15.122:0/752966931 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f0180007840 con 0x7f0188143a20 2024-04-17T02:22:00.746 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:22:00.745+0000 7f2a73a0f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-17T02:22:00.802 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:22:00.801+0000 7f2a73a0f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-17T02:22:00.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.803+0000 7f0190352640 1 -- 172.21.15.122:0/752966931 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2973665c-6c5e-4688-bffe-72d3bdcf467f", "id": 0} v 0) -- 0x7f01880728d0 con 0x7f0188143a20 2024-04-17T02:22:00.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.811+0000 7f017effd640 1 -- 172.21.15.122:0/752966931 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2973665c-6c5e-4688-bffe-72d3bdcf467f", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f018000abd0 con 0x7f0188143a20 2024-04-17T02:22:00.812 INFO:teuthology.orchestra.run.smithi122.stdout:0 2024-04-17T02:22:00.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.812+0000 7f0190352640 10 mgrc shutdown 2024-04-17T02:22:00.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.812+0000 7f0190352640 1 -- 172.21.15.122:0/752966931 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0188143a20 msgr2=0x7f018813e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:00.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.812+0000 7f0190352640 1 --2- 172.21.15.122:0/752966931 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0188143a20 0x7f018813e530 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f018000c780 tx=0x7f018000cc40 comp rx=0 tx=0).stop 2024-04-17T02:22:00.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.812+0000 7f0190352640 1 -- 172.21.15.122:0/752966931 shutdown_connections 2024-04-17T02:22:00.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.812+0000 7f0190352640 1 --2- 172.21.15.122:0/752966931 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0188143a20 0x7f018813e530 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:00.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.812+0000 7f0190352640 1 --2- 172.21.15.122:0/752966931 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f01880a60e0 0x7f01881cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:00.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.812+0000 7f0190352640 1 --2- 172.21.15.122:0/752966931 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01880733d0 0x7f01880adc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:00.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.812+0000 7f0190352640 1 -- 172.21.15.122:0/752966931 >> 172.21.15.122:0/752966931 conn(0x7f01880746a0 msgr2=0x7f01880a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:00.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.812+0000 7f0190352640 1 -- 172.21.15.122:0/752966931 shutdown_connections 2024-04-17T02:22:00.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.812+0000 7f0190352640 1 -- 172.21.15.122:0/752966931 wait complete. 2024-04-17T02:22:00.823 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd new a59a034d-19b4-47e8-8ca5-538597b4af1a 1 2024-04-17T02:22:00.926 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.925+0000 7ff114093640 1 Processor -- start 2024-04-17T02:22:00.927 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.926+0000 7ff114093640 1 -- start start 2024-04-17T02:22:00.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.926+0000 7ff114093640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff10c0bb460 0x7ff10c142580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:00.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.926+0000 7ff114093640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff10c0acea0 con 0x7ff10c142ac0 2024-04-17T02:22:00.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.926+0000 7ff114093640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff10c06dd30 con 0x7ff10c0ab5b0 2024-04-17T02:22:00.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.926+0000 7ff114093640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7ff10c0ab990 con 0x7ff10c0bb460 2024-04-17T02:22:00.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.926+0000 7ff111e2f640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7ff10c0ab5b0 0x7ff10c0ac680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:40426/0 (socket says 172.21.15.122:40426) 2024-04-17T02:22:00.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.926+0000 7ff111e2f640 1 -- 172.21.15.122:0/1515820205 learned_addr learned my addr 172.21.15.122:0/1515820205 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-04-17T02:22:00.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.927+0000 7ff11162e640 1 --2- 172.21.15.122:0/1515820205 >> v2:172.21.15.17:3300/0 conn(0x7ff10c0bb460 0x7ff10c142580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:00.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.927+0000 7ff110e2d640 1 -- 172.21.15.122:0/1515820205 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3463088628 0 0) 0x7ff10c06dd30 con 0x7ff10c0ab5b0 2024-04-17T02:22:00.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.927+0000 7ff110e2d640 1 -- 172.21.15.122:0/1515820205 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0f8003520 con 0x7ff10c0ab5b0 2024-04-17T02:22:00.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.927+0000 7ff110e2d640 1 -- 172.21.15.122:0/1515820205 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 209042345 0 0) 0x7ff10c0acea0 con 0x7ff10c142ac0 2024-04-17T02:22:00.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.927+0000 7ff110e2d640 1 -- 172.21.15.122:0/1515820205 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff10c06dd30 con 0x7ff10c142ac0 2024-04-17T02:22:00.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.927+0000 7ff110e2d640 1 -- 172.21.15.122:0/1515820205 <== mon.1 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 398267722 0 0) 0x7ff0f8003520 con 0x7ff10c0ab5b0 2024-04-17T02:22:00.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.927+0000 7ff110e2d640 1 -- 172.21.15.122:0/1515820205 >> v2:172.21.15.17:3300/0 conn(0x7ff10c0bb460 msgr2=0x7ff10c142580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:00.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.927+0000 7ff110e2d640 1 --2- 172.21.15.122:0/1515820205 >> v2:172.21.15.17:3300/0 conn(0x7ff10c0bb460 0x7ff10c142580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:00.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.927+0000 7ff110e2d640 1 -- 172.21.15.122:0/1515820205 >> v1:172.21.15.17:6789/0 conn(0x7ff10c142ac0 legacy=0x7ff10c14fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:00.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.927+0000 7ff110e2d640 1 -- 172.21.15.122:0/1515820205 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff10c0a7400 con 0x7ff10c0ab5b0 2024-04-17T02:22:00.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.927+0000 7ff110e2d640 1 -- 172.21.15.122:0/1515820205 <== mon.1 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1752030744 0 0) 0x7ff108001670 con 0x7ff10c0ab5b0 2024-04-17T02:22:00.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.927+0000 7ff11162e640 1 --2- 172.21.15.122:0/1515820205 >> v2:172.21.15.17:3300/0 conn(0x7ff10c0bb460 0x7ff10c142580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:00.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.927+0000 7ff110e2d640 1 -- 172.21.15.122:0/1515820205 >> v1:172.21.15.122:6789/0 conn(0x7ff10c0ab5b0 legacy=0x7ff10c0ac680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:00.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.927+0000 7ff110e2d640 1 --2- 172.21.15.122:0/1515820205 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0f8003b90 0x7ff0f8003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:00.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.927+0000 7ff110e2d640 1 --2- 172.21.15.122:0/1515820205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0f8004800 0x7ff0f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:00.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.927+0000 7ff110e2d640 1 --2- 172.21.15.122:0/1515820205 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7ff0f80051c0 0x7ff0f800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:00.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.927+0000 7ff110e2d640 1 -- 172.21.15.122:0/1515820205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff10c0ab990 con 0x7ff0f8004800 2024-04-17T02:22:00.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.927+0000 7ff110e2d640 1 -- 172.21.15.122:0/1515820205 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f800c090 con 0x7ff0f8003b90 2024-04-17T02:22:00.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.927+0000 7ff110e2d640 1 -- 172.21.15.122:0/1515820205 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7ff0f800c290 con 0x7ff0f80051c0 2024-04-17T02:22:00.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.927+0000 7ff111e2f640 1 --2- 172.21.15.122:0/1515820205 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0f8003b90 0x7ff0f8003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:00.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.927+0000 7ff11162e640 1 --2- 172.21.15.122:0/1515820205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0f8004800 0x7ff0f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:00.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.927+0000 7ff112630640 1 --2- 172.21.15.122:0/1515820205 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7ff0f80051c0 0x7ff0f800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:00.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.928+0000 7ff111e2f640 1 -- 172.21.15.122:0/1515820205 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7ff0f80051c0 msgr2=0x7ff0f800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:00.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.928+0000 7ff111e2f640 1 --2- 172.21.15.122:0/1515820205 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7ff0f80051c0 0x7ff0f800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:00.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.928+0000 7ff111e2f640 1 -- 172.21.15.122:0/1515820205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0f8004800 msgr2=0x7ff0f8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:00.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.928+0000 7ff111e2f640 1 --2- 172.21.15.122:0/1515820205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0f8004800 0x7ff0f8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:00.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.928+0000 7ff111e2f640 1 -- 172.21.15.122:0/1515820205 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f8003520 con 0x7ff0f8003b90 2024-04-17T02:22:00.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.928+0000 7ff112630640 1 --2- 172.21.15.122:0/1515820205 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7ff0f80051c0 0x7ff0f800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T02:22:00.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.928+0000 7ff11162e640 1 --2- 172.21.15.122:0/1515820205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0f8004800 0x7ff0f8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T02:22:00.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.928+0000 7ff112630640 1 -- 172.21.15.122:0/1515820205 reap_dead start 2024-04-17T02:22:00.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.928+0000 7ff111e2f640 1 --2- 172.21.15.122:0/1515820205 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0f8003b90 0x7ff0f8003f90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff10800c0e0 tx=0x7ff0f8005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=637ba1818563a239 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:00.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.928+0000 7ff110e2d640 1 -- 172.21.15.122:0/1515820205 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff108007c40 con 0x7ff0f8003b90 2024-04-17T02:22:00.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.928+0000 7ff110e2d640 1 -- 172.21.15.122:0/1515820205 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff108030070 con 0x7ff0f8003b90 2024-04-17T02:22:00.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.928+0000 7ff110e2d640 1 -- 172.21.15.122:0/1515820205 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff108005d90 con 0x7ff0f8003b90 2024-04-17T02:22:00.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.929+0000 7ff114093640 1 -- 172.21.15.122:0/1515820205 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0f8003b90 msgr2=0x7ff0f8003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:00.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.929+0000 7ff114093640 1 --2- 172.21.15.122:0/1515820205 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0f8003b90 0x7ff0f8003f90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff10800c0e0 tx=0x7ff0f8005830 comp rx=0 tx=0).stop 2024-04-17T02:22:00.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.929+0000 7ff114093640 1 -- 172.21.15.122:0/1515820205 shutdown_connections 2024-04-17T02:22:00.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.929+0000 7ff114093640 1 --2- 172.21.15.122:0/1515820205 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0f8003b90 0x7ff0f8003f90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:00.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.929+0000 7ff114093640 1 -- 172.21.15.122:0/1515820205 >> 172.21.15.122:0/1515820205 conn(0x7ff10c0ba940 msgr2=0x7ff10c0bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:00.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.929+0000 7ff114093640 1 -- 172.21.15.122:0/1515820205 shutdown_connections 2024-04-17T02:22:00.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.929+0000 7ff114093640 1 -- 172.21.15.122:0/1515820205 wait complete. 2024-04-17T02:22:00.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.930+0000 7ff114093640 1 Processor -- start 2024-04-17T02:22:00.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.930+0000 7ff114093640 1 -- start start 2024-04-17T02:22:00.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.931+0000 7ff114093640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0f8003b90 0x7ff10c1cec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:00.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.931+0000 7ff114093640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7ff10c1432e0 0x7ff10c1dae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:00.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.931+0000 7ff114093640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff10c13c7c0 0x7ff10c1db350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:00.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.931+0000 7ff114093640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff10c142580 con 0x7ff10c13c7c0 2024-04-17T02:22:00.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.931+0000 7ff114093640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff10c142700 con 0x7ff0f8003b90 2024-04-17T02:22:00.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.931+0000 7ff114093640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7ff10c142880 con 0x7ff10c1432e0 2024-04-17T02:22:00.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.931+0000 7ff111e2f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0f8003b90 0x7ff10c1cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:00.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.931+0000 7ff111e2f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0f8003b90 0x7ff10c1cec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:42738/0 (socket says 172.21.15.122:42738) 2024-04-17T02:22:00.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.931+0000 7ff111e2f640 1 -- 172.21.15.122:0/2409370043 learned_addr learned my addr 172.21.15.122:0/2409370043 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-04-17T02:22:00.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.931+0000 7ff11162e640 1 --2- 172.21.15.122:0/2409370043 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7ff10c1432e0 0x7ff10c1dae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:00.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.931+0000 7ff112630640 1 --2- 172.21.15.122:0/2409370043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff10c13c7c0 0x7ff10c1db350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:00.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.931+0000 7ff111e2f640 1 -- 172.21.15.122:0/2409370043 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7ff10c1432e0 msgr2=0x7ff10c1dae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:00.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.931+0000 7ff111e2f640 1 --2- 172.21.15.122:0/2409370043 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7ff10c1432e0 0x7ff10c1dae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:00.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.931+0000 7ff111e2f640 1 -- 172.21.15.122:0/2409370043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff10c13c7c0 msgr2=0x7ff10c1db350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:00.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.931+0000 7ff111e2f640 1 --2- 172.21.15.122:0/2409370043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff10c13c7c0 0x7ff10c1db350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:00.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.931+0000 7ff111e2f640 1 -- 172.21.15.122:0/2409370043 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff10c1dba80 con 0x7ff0f8003b90 2024-04-17T02:22:00.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.931+0000 7ff11162e640 1 --2- 172.21.15.122:0/2409370043 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7ff10c1432e0 0x7ff10c1dae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:00.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.932+0000 7ff111e2f640 1 --2- 172.21.15.122:0/2409370043 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0f8003b90 0x7ff10c1cec40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff10800c0e0 tx=0x7ff10802e070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:00.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.932+0000 7ff1027fc640 1 -- 172.21.15.122:0/2409370043 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff108007c40 con 0x7ff0f8003b90 2024-04-17T02:22:00.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.932+0000 7ff1027fc640 1 -- 172.21.15.122:0/2409370043 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff10802cbe0 con 0x7ff0f8003b90 2024-04-17T02:22:00.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.932+0000 7ff114093640 1 -- 172.21.15.122:0/2409370043 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff10c147db0 con 0x7ff0f8003b90 2024-04-17T02:22:00.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.932+0000 7ff1027fc640 1 -- 172.21.15.122:0/2409370043 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff108007070 con 0x7ff0f8003b90 2024-04-17T02:22:00.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.932+0000 7ff114093640 1 -- 172.21.15.122:0/2409370043 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff10c145040 con 0x7ff0f8003b90 2024-04-17T02:22:00.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.932+0000 7ff1027fc640 1 -- 172.21.15.122:0/2409370043 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff1080075a0 con 0x7ff0f8003b90 2024-04-17T02:22:00.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.932+0000 7ff1027fc640 20 mgrc handle_mgr_map mgrmap(e 1) 2024-04-17T02:22:00.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.932+0000 7ff1027fc640 4 mgrc handle_mgr_map Got map version 1 2024-04-17T02:22:00.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.932+0000 7ff1027fc640 4 mgrc handle_mgr_map Active mgr is now 2024-04-17T02:22:00.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.932+0000 7ff1027fc640 4 mgrc reconnect No active mgr available yet 2024-04-17T02:22:00.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.932+0000 7ff1027fc640 1 -- 172.21.15.122:0/2409370043 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7ff10804a4c0 con 0x7ff0f8003b90 2024-04-17T02:22:00.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.933+0000 7ff114093640 1 -- 172.21.15.122:0/2409370043 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff10c0687f0 con 0x7ff0f8003b90 2024-04-17T02:22:00.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:00.935+0000 7ff1027fc640 1 -- 172.21.15.122:0/2409370043 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7ff10804a710 con 0x7ff0f8003b90 2024-04-17T02:22:00.939 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:22:00.937+0000 7fa65242b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-17T02:22:00.939 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:22:00.938+0000 7fc978c11040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-17T02:22:00.995 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:22:00.994+0000 7fa65242b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-17T02:22:00.995 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:22:00.994+0000 7fc978c11040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-17T02:22:01.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.008+0000 7ff114093640 1 -- 172.21.15.122:0/2409370043 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a59a034d-19b4-47e8-8ca5-538597b4af1a", "id": 1} v 0) -- 0x7ff10c141c50 con 0x7ff0f8003b90 2024-04-17T02:22:01.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.016+0000 7ff1027fc640 1 -- 172.21.15.122:0/2409370043 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a59a034d-19b4-47e8-8ca5-538597b4af1a", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7ff10804aa20 con 0x7ff0f8003b90 2024-04-17T02:22:01.017 INFO:teuthology.orchestra.run.smithi122.stdout:1 2024-04-17T02:22:01.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.017+0000 7ff114093640 10 mgrc shutdown 2024-04-17T02:22:01.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.017+0000 7ff114093640 1 -- 172.21.15.122:0/2409370043 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0f8003b90 msgr2=0x7ff10c1cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:01.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.017+0000 7ff114093640 1 --2- 172.21.15.122:0/2409370043 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0f8003b90 0x7ff10c1cec40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff10800c0e0 tx=0x7ff10802e070 comp rx=0 tx=0).stop 2024-04-17T02:22:01.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.017+0000 7ff114093640 1 -- 172.21.15.122:0/2409370043 shutdown_connections 2024-04-17T02:22:01.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.017+0000 7ff114093640 1 --2- 172.21.15.122:0/2409370043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff10c13c7c0 0x7ff10c1db350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:01.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.017+0000 7ff114093640 1 --2- 172.21.15.122:0/2409370043 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7ff10c1432e0 0x7ff10c1dae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:01.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.017+0000 7ff114093640 1 --2- 172.21.15.122:0/2409370043 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0f8003b90 0x7ff10c1cec40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:01.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.017+0000 7ff114093640 1 -- 172.21.15.122:0/2409370043 >> 172.21.15.122:0/2409370043 conn(0x7ff10c0ba940 msgr2=0x7ff10c1401a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:01.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.017+0000 7ff114093640 1 -- 172.21.15.122:0/2409370043 shutdown_connections 2024-04-17T02:22:01.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.017+0000 7ff114093640 1 -- 172.21.15.122:0/2409370043 wait complete. 2024-04-17T02:22:01.028 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd new 070f4c5f-459f-46ff-b980-05b1ac50c951 2 2024-04-17T02:22:01.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.130+0000 7f651346e640 1 Processor -- start 2024-04-17T02:22:01.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.130+0000 7f651346e640 1 -- start start 2024-04-17T02:22:01.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.131+0000 7f651346e640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f650c0bb460 0x7f650c142580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:01.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.131+0000 7f651346e640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f650c142ac0 0x7f650c14fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:01.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.131+0000 7f651346e640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f650c0acea0 con 0x7f650c0ab5b0 2024-04-17T02:22:01.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.131+0000 7f651346e640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f650c0ab990 con 0x7f650c142ac0 2024-04-17T02:22:01.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.131+0000 7f651346e640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f650c06c330 con 0x7f650c0bb460 2024-04-17T02:22:01.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.131+0000 7f651120a640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f650c0ab5b0 0x7f650c0ac680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:40438/0 (socket says 172.21.15.122:40438) 2024-04-17T02:22:01.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.131+0000 7f651120a640 1 -- 172.21.15.122:0/4195251382 learned_addr learned my addr 172.21.15.122:0/4195251382 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-04-17T02:22:01.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.131+0000 7f6511a0b640 1 --2- 172.21.15.122:0/4195251382 >> v2:172.21.15.122:3300/0 conn(0x7f650c142ac0 0x7f650c14fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:01.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.131+0000 7f6510a09640 1 --2- 172.21.15.122:0/4195251382 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f650c0bb460 0x7f650c142580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:01.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.132+0000 7f6511a0b640 1 -- 172.21.15.122:0/4195251382 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f650c0bb460 msgr2=0x7f650c142580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:01.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.132+0000 7f6511a0b640 1 --2- 172.21.15.122:0/4195251382 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f650c0bb460 0x7f650c142580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:01.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.132+0000 7f6511a0b640 1 -- 172.21.15.122:0/4195251382 >> v1:172.21.15.122:6789/0 conn(0x7f650c0ab5b0 legacy=0x7f650c0ac680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:01.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.132+0000 7f6511a0b640 1 -- 172.21.15.122:0/4195251382 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f650c06dd30 con 0x7f650c142ac0 2024-04-17T02:22:01.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.132+0000 7f6503fff640 1 -- 172.21.15.122:0/4195251382 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 745940854 0 0) 0x7f650c0acea0 con 0x7f650c0ab5b0 2024-04-17T02:22:01.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.132+0000 7f6511a0b640 1 --2- 172.21.15.122:0/4195251382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f650c142ac0 0x7f650c14fa90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6504009d90 tx=0x7f650402bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=830f5e13bf977e1d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:01.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.133+0000 7f6503fff640 1 -- 172.21.15.122:0/4195251382 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6504039070 con 0x7f650c142ac0 2024-04-17T02:22:01.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.133+0000 7f6503fff640 1 -- 172.21.15.122:0/4195251382 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f650402cc50 con 0x7f650c142ac0 2024-04-17T02:22:01.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.133+0000 7f6503fff640 1 -- 172.21.15.122:0/4195251382 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6504034440 con 0x7f650c142ac0 2024-04-17T02:22:01.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.133+0000 7f651346e640 1 -- 172.21.15.122:0/4195251382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f650c142ac0 msgr2=0x7f650c14fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:01.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.133+0000 7f651346e640 1 --2- 172.21.15.122:0/4195251382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f650c142ac0 0x7f650c14fa90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6504009d90 tx=0x7f650402bea0 comp rx=0 tx=0).stop 2024-04-17T02:22:01.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.133+0000 7f651346e640 1 -- 172.21.15.122:0/4195251382 shutdown_connections 2024-04-17T02:22:01.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.133+0000 7f651346e640 1 --2- 172.21.15.122:0/4195251382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f650c142ac0 0x7f650c14fa90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:01.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.133+0000 7f651346e640 1 --2- 172.21.15.122:0/4195251382 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f650c0bb460 0x7f650c142580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:01.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.133+0000 7f651346e640 1 -- 172.21.15.122:0/4195251382 >> 172.21.15.122:0/4195251382 conn(0x7f650c0ba940 msgr2=0x7f650c0bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:01.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.133+0000 7f651346e640 1 -- 172.21.15.122:0/4195251382 shutdown_connections 2024-04-17T02:22:01.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.133+0000 7f651346e640 1 -- 172.21.15.122:0/4195251382 wait complete. 2024-04-17T02:22:01.138 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.134+0000 7f651346e640 1 Processor -- start 2024-04-17T02:22:01.138 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.134+0000 7f651346e640 1 -- start start 2024-04-17T02:22:01.138 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.135+0000 7f651346e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f650c0ab5b0 0x7f650c145ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:01.138 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.135+0000 7f651346e640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f650c0bb460 0x7f650c147c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:01.138 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.135+0000 7f651346e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f650c142ac0 0x7f650c1da800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:01.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.135+0000 7f651346e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f650c0a9880 con 0x7f650c142ac0 2024-04-17T02:22:01.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.135+0000 7f651346e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f650c0a9700 con 0x7f650c0ab5b0 2024-04-17T02:22:01.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.135+0000 7f651346e640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f650c14ffd0 con 0x7f650c0bb460 2024-04-17T02:22:01.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.135+0000 7f651120a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f650c0ab5b0 0x7f650c145ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:01.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.135+0000 7f651120a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f650c0ab5b0 0x7f650c145ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:42766/0 (socket says 172.21.15.122:42766) 2024-04-17T02:22:01.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.135+0000 7f651120a640 1 -- 172.21.15.122:0/2528201183 learned_addr learned my addr 172.21.15.122:0/2528201183 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-04-17T02:22:01.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.135+0000 7f6510a09640 1 --2- 172.21.15.122:0/2528201183 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f650c0bb460 0x7f650c147c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:01.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.135+0000 7f6511a0b640 1 --2- 172.21.15.122:0/2528201183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f650c142ac0 0x7f650c1da800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:01.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.135+0000 7f651120a640 1 -- 172.21.15.122:0/2528201183 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f650c0bb460 msgr2=0x7f650c147c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:01.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.135+0000 7f651120a640 1 --2- 172.21.15.122:0/2528201183 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f650c0bb460 0x7f650c147c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:01.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.135+0000 7f651120a640 1 -- 172.21.15.122:0/2528201183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f650c142ac0 msgr2=0x7f650c1da800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:01.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.135+0000 7f651120a640 1 --2- 172.21.15.122:0/2528201183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f650c142ac0 0x7f650c1da800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:01.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.135+0000 7f651120a640 1 -- 172.21.15.122:0/2528201183 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f650c1485f0 con 0x7f650c0ab5b0 2024-04-17T02:22:01.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.136+0000 7f651120a640 1 --2- 172.21.15.122:0/2528201183 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f650c0ab5b0 0x7f650c145ac0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f650800c4d0 tx=0x7f650800c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:01.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.136+0000 7f6501ffb640 1 -- 172.21.15.122:0/2528201183 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6508018070 con 0x7f650c0ab5b0 2024-04-17T02:22:01.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.136+0000 7f6501ffb640 1 -- 172.21.15.122:0/2528201183 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6508007500 con 0x7f650c0ab5b0 2024-04-17T02:22:01.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.136+0000 7f651346e640 1 -- 172.21.15.122:0/2528201183 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f650c1da3b0 con 0x7f650c0ab5b0 2024-04-17T02:22:01.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.136+0000 7f6501ffb640 1 -- 172.21.15.122:0/2528201183 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6508004a20 con 0x7f650c0ab5b0 2024-04-17T02:22:01.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.136+0000 7f6501ffb640 1 -- 172.21.15.122:0/2528201183 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f650801b070 con 0x7f650c0ab5b0 2024-04-17T02:22:01.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.136+0000 7f6501ffb640 20 mgrc handle_mgr_map mgrmap(e 1) 2024-04-17T02:22:01.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.136+0000 7f6501ffb640 4 mgrc handle_mgr_map Got map version 1 2024-04-17T02:22:01.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.136+0000 7f6501ffb640 4 mgrc handle_mgr_map Active mgr is now 2024-04-17T02:22:01.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.136+0000 7f651346e640 1 -- 172.21.15.122:0/2528201183 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f650c146560 con 0x7f650c0ab5b0 2024-04-17T02:22:01.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.136+0000 7f6501ffb640 4 mgrc reconnect No active mgr available yet 2024-04-17T02:22:01.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.136+0000 7f6501ffb640 1 -- 172.21.15.122:0/2528201183 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f650801cc20 con 0x7f650c0ab5b0 2024-04-17T02:22:01.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.137+0000 7f651346e640 1 -- 172.21.15.122:0/2528201183 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f650c0687f0 con 0x7f650c0ab5b0 2024-04-17T02:22:01.141 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.139+0000 7f6501ffb640 1 -- 172.21.15.122:0/2528201183 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f6508023020 con 0x7f650c0ab5b0 2024-04-17T02:22:01.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.212+0000 7f651346e640 1 -- 172.21.15.122:0/2528201183 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd new", "uuid": "070f4c5f-459f-46ff-b980-05b1ac50c951", "id": 2} v 0) -- 0x7f650c073250 con 0x7f650c0ab5b0 2024-04-17T02:22:01.218 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.217+0000 7f6501ffb640 1 -- 172.21.15.122:0/2528201183 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "070f4c5f-459f-46ff-b980-05b1ac50c951", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f6508004bc0 con 0x7f650c0ab5b0 2024-04-17T02:22:01.218 INFO:teuthology.orchestra.run.smithi122.stdout:2 2024-04-17T02:22:01.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.218+0000 7f651346e640 10 mgrc shutdown 2024-04-17T02:22:01.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.218+0000 7f651346e640 1 -- 172.21.15.122:0/2528201183 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f650c0ab5b0 msgr2=0x7f650c145ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:01.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.218+0000 7f651346e640 1 --2- 172.21.15.122:0/2528201183 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f650c0ab5b0 0x7f650c145ac0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f650800c4d0 tx=0x7f650800c990 comp rx=0 tx=0).stop 2024-04-17T02:22:01.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.218+0000 7f651346e640 1 -- 172.21.15.122:0/2528201183 shutdown_connections 2024-04-17T02:22:01.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.218+0000 7f651346e640 1 --2- 172.21.15.122:0/2528201183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f650c142ac0 0x7f650c1da800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:01.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.218+0000 7f651346e640 1 --2- 172.21.15.122:0/2528201183 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f650c0bb460 0x7f650c147c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:01.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.218+0000 7f651346e640 1 --2- 172.21.15.122:0/2528201183 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f650c0ab5b0 0x7f650c145ac0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:01.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.218+0000 7f651346e640 1 -- 172.21.15.122:0/2528201183 >> 172.21.15.122:0/2528201183 conn(0x7f650c0ba940 msgr2=0x7f650c1401a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:01.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.218+0000 7f651346e640 1 -- 172.21.15.122:0/2528201183 shutdown_connections 2024-04-17T02:22:01.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.218+0000 7f651346e640 1 -- 172.21.15.122:0/2528201183 wait complete. 2024-04-17T02:22:01.229 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd new 96216a49-a7b6-40eb-bc93-cc8c78a5270a 3 2024-04-17T02:22:01.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.332+0000 7f4bc6cff640 1 Processor -- start 2024-04-17T02:22:01.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.332+0000 7f4bc6cff640 1 -- start start 2024-04-17T02:22:01.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.333+0000 7f4bc6cff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f4bc0067240 0x7f4bc00a1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:01.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.333+0000 7f4bc6cff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4bc0146400 0x7f4bc0142640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:01.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.333+0000 7f4bc6cff640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bc00a13d0 con 0x7f4bc0067620 2024-04-17T02:22:01.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.333+0000 7f4bc6cff640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f4bc00a1dc0 con 0x7f4bc0146400 2024-04-17T02:22:01.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.333+0000 7f4bc6cff640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f4bc0146960 con 0x7f4bc0067240 2024-04-17T02:22:01.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.333+0000 7f4bbffff640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f4bc0067620 0x7f4bc00a54d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:40446/0 (socket says 172.21.15.122:40446) 2024-04-17T02:22:01.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.333+0000 7f4bbffff640 1 -- 172.21.15.122:0/806167445 learned_addr learned my addr 172.21.15.122:0/806167445 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-04-17T02:22:01.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.333+0000 7f4bc529c640 1 --2- 172.21.15.122:0/806167445 >> v2:172.21.15.17:3300/0 conn(0x7f4bc0146400 0x7f4bc0142640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:01.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.333+0000 7f4bc4a9b640 1 --2- 172.21.15.122:0/806167445 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f4bc0067240 0x7f4bc00a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:01.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.333+0000 7f4bbf7fe640 1 -- 172.21.15.122:0/806167445 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3236909064 0 0) 0x7f4bc00a13d0 con 0x7f4bc0067620 2024-04-17T02:22:01.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.333+0000 7f4bbf7fe640 1 -- 172.21.15.122:0/806167445 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bb0003520 con 0x7f4bc0067620 2024-04-17T02:22:01.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.333+0000 7f4bc4a9b640 1 -- 172.21.15.122:0/806167445 >> v2:172.21.15.17:3300/0 conn(0x7f4bc0146400 msgr2=0x7f4bc0142640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:01.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.333+0000 7f4bc4a9b640 1 --2- 172.21.15.122:0/806167445 >> v2:172.21.15.17:3300/0 conn(0x7f4bc0146400 0x7f4bc0142640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:01.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.333+0000 7f4bc4a9b640 1 -- 172.21.15.122:0/806167445 >> v1:172.21.15.122:6789/0 conn(0x7f4bc0067620 legacy=0x7f4bc00a54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:01.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.333+0000 7f4bc4a9b640 1 -- 172.21.15.122:0/806167445 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc0146c20 con 0x7f4bc0067240 2024-04-17T02:22:01.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.333+0000 7f4bc529c640 1 --2- 172.21.15.122:0/806167445 >> v2:172.21.15.17:3300/0 conn(0x7f4bc0146400 0x7f4bc0142640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:01.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.334+0000 7f4bc4a9b640 1 --2- 172.21.15.122:0/806167445 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f4bc0067240 0x7f4bc00a1880 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4bb40097a0 tx=0x7f4bb402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b58a02a9994448e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:01.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.334+0000 7f4bbf7fe640 1 -- 172.21.15.122:0/806167445 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb4035020 con 0x7f4bc0067240 2024-04-17T02:22:01.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.334+0000 7f4bbf7fe640 1 -- 172.21.15.122:0/806167445 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bb4031830 con 0x7f4bc0067240 2024-04-17T02:22:01.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.334+0000 7f4bbf7fe640 1 -- 172.21.15.122:0/806167445 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb4031c00 con 0x7f4bc0067240 2024-04-17T02:22:01.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.335+0000 7f4bc6cff640 1 -- 172.21.15.122:0/806167445 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f4bc0067240 msgr2=0x7f4bc00a1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:01.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.335+0000 7f4bc6cff640 1 --2- 172.21.15.122:0/806167445 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f4bc0067240 0x7f4bc00a1880 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4bb40097a0 tx=0x7f4bb402b8d0 comp rx=0 tx=0).stop 2024-04-17T02:22:01.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.335+0000 7f4bc6cff640 1 -- 172.21.15.122:0/806167445 shutdown_connections 2024-04-17T02:22:01.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.335+0000 7f4bc6cff640 1 --2- 172.21.15.122:0/806167445 >> v2:172.21.15.17:3300/0 conn(0x7f4bc0146400 0x7f4bc0142640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:01.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.335+0000 7f4bc6cff640 1 --2- 172.21.15.122:0/806167445 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f4bc0067240 0x7f4bc00a1880 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:01.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.335+0000 7f4bc6cff640 1 -- 172.21.15.122:0/806167445 >> 172.21.15.122:0/806167445 conn(0x7f4bc00a6680 msgr2=0x7f4bc00b6ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:01.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.335+0000 7f4bc6cff640 1 -- 172.21.15.122:0/806167445 shutdown_connections 2024-04-17T02:22:01.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.335+0000 7f4bc6cff640 1 -- 172.21.15.122:0/806167445 wait complete. 2024-04-17T02:22:01.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.336+0000 7f4bc6cff640 1 Processor -- start 2024-04-17T02:22:01.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.336+0000 7f4bc6cff640 1 -- start start 2024-04-17T02:22:01.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.337+0000 7f4bc6cff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4bc0067240 0x7f4bc00a8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:01.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.337+0000 7f4bc6cff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bc0146400 0x7f4bc0139b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:01.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.337+0000 7f4bc6cff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f4bc0072d40 0x7f4bc013a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:01.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.337+0000 7f4bc6cff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc0142d00 con 0x7f4bc0146400 2024-04-17T02:22:01.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.337+0000 7f4bc6cff640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc0142b80 con 0x7f4bc0067240 2024-04-17T02:22:01.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.337+0000 7f4bc6cff640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f4bc014d730 con 0x7f4bc0072d40 2024-04-17T02:22:01.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.337+0000 7f4bc4a9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4bc0067240 0x7f4bc00a8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:01.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.337+0000 7f4bc4a9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4bc0067240 0x7f4bc00a8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:42780/0 (socket says 172.21.15.122:42780) 2024-04-17T02:22:01.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.337+0000 7f4bc4a9b640 1 -- 172.21.15.122:0/1622543645 learned_addr learned my addr 172.21.15.122:0/1622543645 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-04-17T02:22:01.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.337+0000 7f4bc529c640 1 --2- 172.21.15.122:0/1622543645 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f4bc0072d40 0x7f4bc013a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:01.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.337+0000 7f4bbffff640 1 --2- 172.21.15.122:0/1622543645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bc0146400 0x7f4bc0139b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:01.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.337+0000 7f4bc4a9b640 1 -- 172.21.15.122:0/1622543645 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f4bc0072d40 msgr2=0x7f4bc013a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:01.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.337+0000 7f4bc4a9b640 1 --2- 172.21.15.122:0/1622543645 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f4bc0072d40 0x7f4bc013a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:01.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.337+0000 7f4bc4a9b640 1 -- 172.21.15.122:0/1622543645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bc0146400 msgr2=0x7f4bc0139b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:01.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.337+0000 7f4bc4a9b640 1 --2- 172.21.15.122:0/1622543645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bc0146400 0x7f4bc0139b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:01.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.337+0000 7f4bc4a9b640 1 -- 172.21.15.122:0/1622543645 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc013a580 con 0x7f4bc0067240 2024-04-17T02:22:01.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.337+0000 7f4bc4a9b640 1 --2- 172.21.15.122:0/1622543645 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4bc0067240 0x7f4bc00a8e80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4bb40098c0 tx=0x7f4bb40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:01.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.337+0000 7f4bbd7fa640 1 -- 172.21.15.122:0/1622543645 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb4035040 con 0x7f4bc0067240 2024-04-17T02:22:01.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.337+0000 7f4bbd7fa640 1 -- 172.21.15.122:0/1622543645 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bb403b860 con 0x7f4bc0067240 2024-04-17T02:22:01.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.337+0000 7f4bc6cff640 1 -- 172.21.15.122:0/1622543645 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bc0072230 con 0x7f4bc0067240 2024-04-17T02:22:01.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.337+0000 7f4bbd7fa640 1 -- 172.21.15.122:0/1622543645 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb403bc50 con 0x7f4bc0067240 2024-04-17T02:22:01.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.338+0000 7f4bc6cff640 1 -- 172.21.15.122:0/1622543645 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bc0142560 con 0x7f4bc0067240 2024-04-17T02:22:01.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.338+0000 7f4bbd7fa640 1 -- 172.21.15.122:0/1622543645 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4bb4038020 con 0x7f4bc0067240 2024-04-17T02:22:01.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.338+0000 7f4bbd7fa640 20 mgrc handle_mgr_map mgrmap(e 1) 2024-04-17T02:22:01.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.338+0000 7f4bbd7fa640 4 mgrc handle_mgr_map Got map version 1 2024-04-17T02:22:01.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.338+0000 7f4bbd7fa640 4 mgrc handle_mgr_map Active mgr is now 2024-04-17T02:22:01.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.338+0000 7f4bbd7fa640 4 mgrc reconnect No active mgr available yet 2024-04-17T02:22:01.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.338+0000 7f4bbd7fa640 1 -- 172.21.15.122:0/1622543645 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f4bb404f880 con 0x7f4bc0067240 2024-04-17T02:22:01.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.338+0000 7f4bc6cff640 1 -- 172.21.15.122:0/1622543645 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bc0067f80 con 0x7f4bc0067240 2024-04-17T02:22:01.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.340+0000 7f4bbd7fa640 1 -- 172.21.15.122:0/1622543645 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f4bb4054080 con 0x7f4bc0067240 2024-04-17T02:22:01.346 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:22:01.346+0000 7f2a73a0f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-17T02:22:01.403 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:22:01.402+0000 7f2a73a0f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-17T02:22:01.414 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.413+0000 7f4bc6cff640 1 -- 172.21.15.122:0/1622543645 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd new", "uuid": "96216a49-a7b6-40eb-bc93-cc8c78a5270a", "id": 3} v 0) -- 0x7f4bc00a2080 con 0x7f4bc0067240 2024-04-17T02:22:01.421 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.421+0000 7f4bbd7fa640 1 -- 172.21.15.122:0/1622543645 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "96216a49-a7b6-40eb-bc93-cc8c78a5270a", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f4bb404f3f0 con 0x7f4bc0067240 2024-04-17T02:22:01.422 INFO:teuthology.orchestra.run.smithi122.stdout:3 2024-04-17T02:22:01.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.422+0000 7f4bc6cff640 10 mgrc shutdown 2024-04-17T02:22:01.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.422+0000 7f4bc6cff640 1 -- 172.21.15.122:0/1622543645 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4bc0067240 msgr2=0x7f4bc00a8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:01.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.422+0000 7f4bc6cff640 1 --2- 172.21.15.122:0/1622543645 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4bc0067240 0x7f4bc00a8e80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4bb40098c0 tx=0x7f4bb40046c0 comp rx=0 tx=0).stop 2024-04-17T02:22:01.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.422+0000 7f4bc6cff640 1 -- 172.21.15.122:0/1622543645 shutdown_connections 2024-04-17T02:22:01.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.422+0000 7f4bc6cff640 1 --2- 172.21.15.122:0/1622543645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bc0146400 0x7f4bc0139b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:01.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.422+0000 7f4bc6cff640 1 --2- 172.21.15.122:0/1622543645 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f4bc0072d40 0x7f4bc013a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:01.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.422+0000 7f4bc6cff640 1 --2- 172.21.15.122:0/1622543645 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4bc0067240 0x7f4bc00a8e80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:01.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.422+0000 7f4bc6cff640 1 -- 172.21.15.122:0/1622543645 >> 172.21.15.122:0/1622543645 conn(0x7f4bc00a6680 msgr2=0x7f4bc006b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:01.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.422+0000 7f4bc6cff640 1 -- 172.21.15.122:0/1622543645 shutdown_connections 2024-04-17T02:22:01.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-17T02:22:01.422+0000 7f4bc6cff640 1 -- 172.21.15.122:0/1622543645 wait complete. 2024-04-17T02:22:01.433 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-17T02:22:01.434 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-17T02:22:01.436 INFO:tasks.ceph.osd.0:Started 2024-04-17T02:22:01.436 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-17T02:22:01.436 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-17T02:22:01.438 INFO:tasks.ceph.osd.1:Started 2024-04-17T02:22:01.438 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-17T02:22:01.438 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-17T02:22:01.440 INFO:tasks.ceph.osd.2:Started 2024-04-17T02:22:01.441 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-17T02:22:01.441 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-17T02:22:01.443 INFO:tasks.ceph.osd.3:Started 2024-04-17T02:22:01.443 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T02:22:01.450 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:22:01.449+0000 7f2a73a0f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-17T02:22:01.509 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:22:01.508+0000 7f2a73a0f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-17T02:22:01.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.550+0000 7f42b0c7b640 1 Processor -- start 2024-04-17T02:22:01.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.550+0000 7f42b0c7b640 1 -- start start 2024-04-17T02:22:01.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.550+0000 7f42b0c7b640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f42ac0a6080 0x7f42ac0a71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:01.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.550+0000 7f42b0c7b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f42ac14b640 0x7f42ac14da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:01.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.550+0000 7f42b0c7b640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42ac072540 con 0x7f42ac0a59c0 2024-04-17T02:22:01.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.550+0000 7f42b0c7b640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f42ac072800 con 0x7f42ac14b640 2024-04-17T02:22:01.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.550+0000 7f42b0c7b640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f42ac071e90 con 0x7f42ac0a6080 2024-04-17T02:22:01.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.550+0000 7f42a3fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f42ac0a59c0 0x7f42ac143720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:43336/0 (socket says 172.21.15.17:43336) 2024-04-17T02:22:01.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.550+0000 7f42a3fff640 1 -- 172.21.15.17:0/4149228907 learned_addr learned my addr 172.21.15.17:0/4149228907 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:22:01.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.550+0000 7f42aa59c640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f42ac0a6080 0x7f42ac0a71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:01.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.550+0000 7f42aad9d640 1 --2- 172.21.15.17:0/4149228907 >> v2:172.21.15.122:3300/0 conn(0x7f42ac14b640 0x7f42ac14da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:01.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.551+0000 7f42a9d9b640 1 -- 172.21.15.17:0/4149228907 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3721893435 0 0) 0x7f42ac072540 con 0x7f42ac0a59c0 2024-04-17T02:22:01.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.551+0000 7f42a9d9b640 1 -- 172.21.15.17:0/4149228907 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4298003520 con 0x7f42ac0a59c0 2024-04-17T02:22:01.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.551+0000 7f42aa59c640 1 -- 172.21.15.17:0/4149228907 >> v2:172.21.15.122:3300/0 conn(0x7f42ac14b640 msgr2=0x7f42ac14da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:01.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.551+0000 7f42aa59c640 1 --2- 172.21.15.17:0/4149228907 >> v2:172.21.15.122:3300/0 conn(0x7f42ac14b640 0x7f42ac14da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:01.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.551+0000 7f42aa59c640 1 -- 172.21.15.17:0/4149228907 >> v1:172.21.15.17:6789/0 conn(0x7f42ac0a59c0 legacy=0x7f42ac143720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:01.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.551+0000 7f42aa59c640 1 -- 172.21.15.17:0/4149228907 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42ac0aad20 con 0x7f42ac0a6080 2024-04-17T02:22:01.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.552+0000 7f42aa59c640 1 --2- 172.21.15.17:0/4149228907 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f42ac0a6080 0x7f42ac0a71d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f429c0097a0 tx=0x7f429c02b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=139b7c21bb779d98 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:01.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.552+0000 7f42a9d9b640 1 -- 172.21.15.17:0/4149228907 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c038070 con 0x7f42ac0a6080 2024-04-17T02:22:01.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.552+0000 7f42a9d9b640 1 -- 172.21.15.17:0/4149228907 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f429c031700 con 0x7f42ac0a6080 2024-04-17T02:22:01.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.552+0000 7f42a9d9b640 1 -- 172.21.15.17:0/4149228907 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c031ad0 con 0x7f42ac0a6080 2024-04-17T02:22:01.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.552+0000 7f42b0c7b640 1 -- 172.21.15.17:0/4149228907 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f42ac0a6080 msgr2=0x7f42ac0a71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:01.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.552+0000 7f42b0c7b640 1 --2- 172.21.15.17:0/4149228907 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f42ac0a6080 0x7f42ac0a71d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f429c0097a0 tx=0x7f429c02b7a0 comp rx=0 tx=0).stop 2024-04-17T02:22:01.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.552+0000 7f42b0c7b640 1 -- 172.21.15.17:0/4149228907 shutdown_connections 2024-04-17T02:22:01.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.552+0000 7f42b0c7b640 1 --2- 172.21.15.17:0/4149228907 >> v2:172.21.15.122:3300/0 conn(0x7f42ac14b640 0x7f42ac14da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:01.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.552+0000 7f42b0c7b640 1 --2- 172.21.15.17:0/4149228907 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f42ac0a6080 0x7f42ac0a71d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:01.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.552+0000 7f42b0c7b640 1 -- 172.21.15.17:0/4149228907 >> 172.21.15.17:0/4149228907 conn(0x7f42ac073fc0 msgr2=0x7f42ac0743d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:01.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.552+0000 7f42b0c7b640 1 -- 172.21.15.17:0/4149228907 shutdown_connections 2024-04-17T02:22:01.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.552+0000 7f42b0c7b640 1 -- 172.21.15.17:0/4149228907 wait complete. 2024-04-17T02:22:01.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.554+0000 7f42b0c7b640 1 Processor -- start 2024-04-17T02:22:01.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.554+0000 7f42b0c7b640 1 -- start start 2024-04-17T02:22:01.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.554+0000 7f42b0c7b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42ac0a59c0 0x7f42ac0a4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:01.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.554+0000 7f42b0c7b640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f42ac0a6080 0x7f42ac13cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:01.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.554+0000 7f42b0c7b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42ac14b640 0x7f42ac13d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:01.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.554+0000 7f42b0c7b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f42ac0a8f30 con 0x7f42ac0a59c0 2024-04-17T02:22:01.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.554+0000 7f42b0c7b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f42ac0a6460 con 0x7f42ac14b640 2024-04-17T02:22:01.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.554+0000 7f42b0c7b640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f42ac143e30 con 0x7f42ac0a6080 2024-04-17T02:22:01.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.554+0000 7f42aa59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42ac0a59c0 0x7f42ac0a4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:01.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.554+0000 7f42a3fff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f42ac0a6080 0x7f42ac13cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:01.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.554+0000 7f42a3fff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f42ac0a6080 0x7f42ac13cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:35210/0 (socket says 172.21.15.17:35210) 2024-04-17T02:22:01.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.554+0000 7f42aa59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42ac0a59c0 0x7f42ac0a4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59134/0 (socket says 172.21.15.17:59134) 2024-04-17T02:22:01.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.554+0000 7f42a3fff640 1 -- 172.21.15.17:0/1674817254 learned_addr learned my addr 172.21.15.17:0/1674817254 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:01.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.554+0000 7f42aad9d640 1 --2- 172.21.15.17:0/1674817254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42ac14b640 0x7f42ac13d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:01.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.555+0000 7f42a3fff640 1 -- 172.21.15.17:0/1674817254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42ac14b640 msgr2=0x7f42ac13d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:01.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.555+0000 7f42a3fff640 1 --2- 172.21.15.17:0/1674817254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42ac14b640 0x7f42ac13d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:01.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.555+0000 7f42a3fff640 1 -- 172.21.15.17:0/1674817254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42ac0a59c0 msgr2=0x7f42ac0a4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:01.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.555+0000 7f42a3fff640 1 --2- 172.21.15.17:0/1674817254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42ac0a59c0 0x7f42ac0a4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:01.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.555+0000 7f42a3fff640 1 -- 172.21.15.17:0/1674817254 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42ac13d740 con 0x7f42ac0a6080 2024-04-17T02:22:01.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.555+0000 7f42a3fff640 1 --2- 172.21.15.17:0/1674817254 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f42ac0a6080 0x7f42ac13cb50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f429400c490 tx=0x7f429400c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:01.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.555+0000 7f42a2ffd640 1 -- 172.21.15.17:0/1674817254 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4294017070 con 0x7f42ac0a6080 2024-04-17T02:22:01.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.555+0000 7f42a2ffd640 1 -- 172.21.15.17:0/1674817254 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4294005ce0 con 0x7f42ac0a6080 2024-04-17T02:22:01.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.555+0000 7f42b0c7b640 1 -- 172.21.15.17:0/1674817254 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42ac13da00 con 0x7f42ac0a6080 2024-04-17T02:22:01.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.555+0000 7f42a2ffd640 1 -- 172.21.15.17:0/1674817254 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4294007290 con 0x7f42ac0a6080 2024-04-17T02:22:01.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.555+0000 7f42b0c7b640 1 -- 172.21.15.17:0/1674817254 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f42ac142f30 con 0x7f42ac0a6080 2024-04-17T02:22:01.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.555+0000 7f42a2ffd640 1 -- 172.21.15.17:0/1674817254 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f429401a070 con 0x7f42ac0a6080 2024-04-17T02:22:01.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.555+0000 7f42a2ffd640 20 mgrc handle_mgr_map mgrmap(e 1) 2024-04-17T02:22:01.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.555+0000 7f42a2ffd640 4 mgrc handle_mgr_map Got map version 1 2024-04-17T02:22:01.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.555+0000 7f42a2ffd640 4 mgrc handle_mgr_map Active mgr is now 2024-04-17T02:22:01.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.555+0000 7f42a2ffd640 4 mgrc reconnect No active mgr available yet 2024-04-17T02:22:01.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.555+0000 7f42a2ffd640 1 -- 172.21.15.17:0/1674817254 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f4294012910 con 0x7f42ac0a6080 2024-04-17T02:22:01.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.556+0000 7f42b0c7b640 1 -- 172.21.15.17:0/1674817254 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42ac072f00 con 0x7f42ac0a6080 2024-04-17T02:22:01.562 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:22:01.556+0000 7f2a73a0f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-17T02:22:01.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.558+0000 7f42a2ffd640 1 -- 172.21.15.17:0/1674817254 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f42ac072f00 con 0x7f42ac0a6080 2024-04-17T02:22:01.584 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:22:01.583+0000 7fc978c11040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-17T02:22:01.584 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:22:01.583+0000 7fa65242b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-17T02:22:01.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.620+0000 7f42b0c7b640 1 -- 172.21.15.17:0/1674817254 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f42ac067f80 con 0x7f42ac0a6080 2024-04-17T02:22:01.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.620+0000 7f42a2ffd640 1 -- 172.21.15.17:0/1674817254 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f4294021070 con 0x7f42ac0a6080 2024-04-17T02:22:01.622 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:22:01.623 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":6,"fsid":"7cbfae20-b10d-41da-92b7-cbd5c1632e23","created":"2024-04-17T02:22:00.246446+0000","modified":"2024-04-17T02:22:01.415384+0000","last_up_change":"0.000000","last_in_change":"2024-04-17T02:22:01.415384+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2973665c-6c5e-4688-bffe-72d3bdcf467f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a59a034d-19b4-47e8-8ca5-538597b4af1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"070f4c5f-459f-46ff-b980-05b1ac50c951","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"96216a49-a7b6-40eb-bc93-cc8c78a5270a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T02:22:01.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.621+0000 7f42b0c7b640 10 mgrc shutdown 2024-04-17T02:22:01.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.621+0000 7f42b0c7b640 1 -- 172.21.15.17:0/1674817254 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f42ac0a6080 msgr2=0x7f42ac13cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:01.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.621+0000 7f42b0c7b640 1 --2- 172.21.15.17:0/1674817254 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f42ac0a6080 0x7f42ac13cb50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f429400c490 tx=0x7f429400c950 comp rx=0 tx=0).stop 2024-04-17T02:22:01.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.621+0000 7f42b0c7b640 1 -- 172.21.15.17:0/1674817254 shutdown_connections 2024-04-17T02:22:01.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.621+0000 7f42b0c7b640 1 --2- 172.21.15.17:0/1674817254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42ac14b640 0x7f42ac13d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:01.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.621+0000 7f42b0c7b640 1 --2- 172.21.15.17:0/1674817254 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f42ac0a6080 0x7f42ac13cb50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:01.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.621+0000 7f42b0c7b640 1 --2- 172.21.15.17:0/1674817254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42ac0a59c0 0x7f42ac0a4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:01.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.621+0000 7f42b0c7b640 1 -- 172.21.15.17:0/1674817254 >> 172.21.15.17:0/1674817254 conn(0x7f42ac073fc0 msgr2=0x7f42ac0a7ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:01.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.621+0000 7f42b0c7b640 1 -- 172.21.15.17:0/1674817254 shutdown_connections 2024-04-17T02:22:01.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:01.621+0000 7f42b0c7b640 1 -- 172.21.15.17:0/1674817254 wait complete. 2024-04-17T02:22:01.633 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-17T02:22:01.633 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-17T02:22:01.640 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:22:01.639+0000 7fc978c11040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-17T02:22:01.640 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:22:01.639+0000 7fa65242b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-17T02:22:01.678 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:22:01.678+0000 7f2a73a0f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-17T02:22:01.687 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:22:01.686+0000 7fc978c11040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-17T02:22:01.688 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:22:01.686+0000 7fa65242b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-17T02:22:01.749 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:22:01.748+0000 7fa65242b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-17T02:22:01.749 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:22:01.748+0000 7fc978c11040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-17T02:22:01.751 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:22:01.750+0000 7f2a73a0f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-17T02:22:01.793 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:22:01.792+0000 7fc978c11040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-17T02:22:01.793 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:22:01.792+0000 7fa65242b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-17T02:22:01.798 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:22:01.798+0000 7f2a73a0f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-17T02:22:01.852 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:22:01.852+0000 7f2a73a0f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-17T02:22:01.901 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:22:01.900+0000 7f2a73a0f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-17T02:22:01.914 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:22:01.913+0000 7fc978c11040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-17T02:22:01.914 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:22:01.913+0000 7fa65242b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-17T02:22:01.987 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:22:01.986+0000 7fa65242b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-17T02:22:01.987 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:22:01.986+0000 7fc978c11040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-17T02:22:02.029 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-04-17T02:22:02.028+0000 7faa2840c640 -1 Falling back to public interface 2024-04-17T02:22:02.035 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:22:02.034+0000 7fa65242b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-17T02:22:02.035 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:22:02.034+0000 7fc978c11040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-17T02:22:02.035 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-17T02:22:02.044 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-04-17T02:22:02.043+0000 7fe506617640 -1 Falling back to public interface 2024-04-17T02:22:02.061 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-04-17T02:22:02.060+0000 7fe0b4581640 -1 Falling back to public interface 2024-04-17T02:22:02.065 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-17T02:22:02.064+0000 7fb906099640 -1 Falling back to public interface 2024-04-17T02:22:02.090 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:22:02.089+0000 7fa65242b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-17T02:22:02.091 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:22:02.090+0000 7fc978c11040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-17T02:22:02.127 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.126+0000 7f58a93c7640 1 Processor -- start 2024-04-17T02:22:02.127 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.126+0000 7f58a93c7640 1 -- start start 2024-04-17T02:22:02.129 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.127+0000 7f58a93c7640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f58a4149090 0x7f58a4073fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:02.129 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.127+0000 7f58a93c7640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f58a414d9e0 0x7f58a414fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:02.129 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.127+0000 7f58a93c7640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58a40a4a50 con 0x7f58a40a5530 2024-04-17T02:22:02.129 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.127+0000 7f58a93c7640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f58a406cd90 con 0x7f58a414d9e0 2024-04-17T02:22:02.130 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.127+0000 7f58a93c7640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f58a40a4cf0 con 0x7f58a4149090 2024-04-17T02:22:02.130 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.127+0000 7f58a2ffd640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f58a4149090 0x7f58a4073fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:02.130 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.127+0000 7f58a27fc640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f58a40a5530 0x7f58a406baa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:43342/0 (socket says 172.21.15.17:43342) 2024-04-17T02:22:02.130 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.127+0000 7f58a2ffd640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f58a4149090 0x7f58a4073fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:35222/0 (socket says 172.21.15.17:35222) 2024-04-17T02:22:02.130 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.127+0000 7f58a27fc640 1 -- 172.21.15.17:0/1310815346 learned_addr learned my addr 172.21.15.17:0/1310815346 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:22:02.130 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.127+0000 7f58a37fe640 1 --2- 172.21.15.17:0/1310815346 >> v2:172.21.15.122:3300/0 conn(0x7f58a414d9e0 0x7f58a414fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:02.130 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.127+0000 7f58a1ffb640 1 -- 172.21.15.17:0/1310815346 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2493512197 0 0) 0x7f58a40a4a50 con 0x7f58a40a5530 2024-04-17T02:22:02.130 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.127+0000 7f58a1ffb640 1 -- 172.21.15.17:0/1310815346 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f588c003520 con 0x7f58a40a5530 2024-04-17T02:22:02.130 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.127+0000 7f58a2ffd640 1 -- 172.21.15.17:0/1310815346 >> v2:172.21.15.122:3300/0 conn(0x7f58a414d9e0 msgr2=0x7f58a414fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:02.130 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.127+0000 7f58a2ffd640 1 --2- 172.21.15.17:0/1310815346 >> v2:172.21.15.122:3300/0 conn(0x7f58a414d9e0 0x7f58a414fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:02.130 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.127+0000 7f58a2ffd640 1 -- 172.21.15.17:0/1310815346 >> v1:172.21.15.17:6789/0 conn(0x7f58a40a5530 legacy=0x7f58a406baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:02.130 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.127+0000 7f58a2ffd640 1 -- 172.21.15.17:0/1310815346 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a406c1b0 con 0x7f58a4149090 2024-04-17T02:22:02.130 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.128+0000 7f58a2ffd640 1 --2- 172.21.15.17:0/1310815346 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f58a4149090 0x7f58a4073fc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f58940097a0 tx=0x7f589402b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26e36d441ea80cd8 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:02.131 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.128+0000 7f58a1ffb640 1 -- 172.21.15.17:0/1310815346 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5894038070 con 0x7f58a4149090 2024-04-17T02:22:02.131 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.128+0000 7f58a1ffb640 1 -- 172.21.15.17:0/1310815346 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5894031700 con 0x7f58a4149090 2024-04-17T02:22:02.131 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.128+0000 7f58a1ffb640 1 -- 172.21.15.17:0/1310815346 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5894031ad0 con 0x7f58a4149090 2024-04-17T02:22:02.135 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.129+0000 7f58a93c7640 1 -- 172.21.15.17:0/1310815346 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f58a4149090 msgr2=0x7f58a4073fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:02.135 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.129+0000 7f58a93c7640 1 --2- 172.21.15.17:0/1310815346 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f58a4149090 0x7f58a4073fc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f58940097a0 tx=0x7f589402b7a0 comp rx=0 tx=0).stop 2024-04-17T02:22:02.135 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.129+0000 7f58a93c7640 1 -- 172.21.15.17:0/1310815346 shutdown_connections 2024-04-17T02:22:02.136 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.129+0000 7f58a93c7640 1 --2- 172.21.15.17:0/1310815346 >> v2:172.21.15.122:3300/0 conn(0x7f58a414d9e0 0x7f58a414fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:02.136 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.129+0000 7f58a93c7640 1 --2- 172.21.15.17:0/1310815346 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f58a4149090 0x7f58a4073fc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:02.136 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.129+0000 7f58a93c7640 1 -- 172.21.15.17:0/1310815346 >> 172.21.15.17:0/1310815346 conn(0x7f58a40a7550 msgr2=0x7f58a40a7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:02.136 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.129+0000 7f58a93c7640 1 -- 172.21.15.17:0/1310815346 shutdown_connections 2024-04-17T02:22:02.136 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.129+0000 7f58a93c7640 1 -- 172.21.15.17:0/1310815346 wait complete. 2024-04-17T02:22:02.136 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.130+0000 7f58a93c7640 1 Processor -- start 2024-04-17T02:22:02.136 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.130+0000 7f58a93c7640 1 -- start start 2024-04-17T02:22:02.136 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.131+0000 7f58a93c7640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f58a40a5530 0x7f58a41435e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:02.136 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.131+0000 7f58a93c7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58a4149090 0x7f58a40702d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:02.136 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.131+0000 7f58a93c7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58a414d9e0 0x7f58a40a2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:02.137 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.131+0000 7f58a93c7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f58a40a46a0 con 0x7f58a4149090 2024-04-17T02:22:02.137 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.131+0000 7f58a93c7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f58a406d820 con 0x7f58a414d9e0 2024-04-17T02:22:02.137 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.131+0000 7f58a93c7640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f58a4070990 con 0x7f58a40a5530 2024-04-17T02:22:02.137 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.131+0000 7f58a2ffd640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f58a40a5530 0x7f58a41435e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:02.138 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.131+0000 7f58a27fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58a4149090 0x7f58a40702d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:02.138 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.131+0000 7f58a2ffd640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f58a40a5530 0x7f58a41435e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:35232/0 (socket says 172.21.15.17:35232) 2024-04-17T02:22:02.138 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.131+0000 7f58a2ffd640 1 -- 172.21.15.17:0/3260833938 learned_addr learned my addr 172.21.15.17:0/3260833938 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:02.138 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.131+0000 7f58a37fe640 1 --2- 172.21.15.17:0/3260833938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58a414d9e0 0x7f58a40a2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:02.138 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.131+0000 7f58a27fc640 1 -- 172.21.15.17:0/3260833938 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f58a40a5530 msgr2=0x7f58a41435e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:02.138 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.131+0000 7f58a27fc640 1 --2- 172.21.15.17:0/3260833938 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f58a40a5530 0x7f58a41435e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:02.138 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.131+0000 7f58a27fc640 1 -- 172.21.15.17:0/3260833938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58a414d9e0 msgr2=0x7f58a40a2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:02.138 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.131+0000 7f58a27fc640 1 --2- 172.21.15.17:0/3260833938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58a414d9e0 0x7f58a40a2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:02.138 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.131+0000 7f58a27fc640 1 -- 172.21.15.17:0/3260833938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a40714c0 con 0x7f58a4149090 2024-04-17T02:22:02.138 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.131+0000 7f58a27fc640 1 --2- 172.21.15.17:0/3260833938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58a4149090 0x7f58a40702d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5898000f60 tx=0x7f5898001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:02.139 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.132+0000 7f588b7fe640 1 -- 172.21.15.17:0/3260833938 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5898017070 con 0x7f58a4149090 2024-04-17T02:22:02.139 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.132+0000 7f588b7fe640 1 -- 172.21.15.17:0/3260833938 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5898005ce0 con 0x7f58a4149090 2024-04-17T02:22:02.139 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.132+0000 7f58a93c7640 1 -- 172.21.15.17:0/3260833938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58a40a1b00 con 0x7f58a4149090 2024-04-17T02:22:02.139 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.132+0000 7f588b7fe640 1 -- 172.21.15.17:0/3260833938 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5898007310 con 0x7f58a4149090 2024-04-17T02:22:02.139 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.132+0000 7f58a93c7640 1 -- 172.21.15.17:0/3260833938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58a40a2cc0 con 0x7f58a4149090 2024-04-17T02:22:02.139 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.132+0000 7f588b7fe640 1 -- 172.21.15.17:0/3260833938 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f589801a070 con 0x7f58a4149090 2024-04-17T02:22:02.139 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.132+0000 7f588b7fe640 20 mgrc handle_mgr_map mgrmap(e 1) 2024-04-17T02:22:02.139 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.132+0000 7f588b7fe640 4 mgrc handle_mgr_map Got map version 1 2024-04-17T02:22:02.139 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.132+0000 7f588b7fe640 4 mgrc handle_mgr_map Active mgr is now 2024-04-17T02:22:02.139 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.132+0000 7f588b7fe640 4 mgrc reconnect No active mgr available yet 2024-04-17T02:22:02.139 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.132+0000 7f588b7fe640 1 -- 172.21.15.17:0/3260833938 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f5898012910 con 0x7f58a4149090 2024-04-17T02:22:02.139 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.133+0000 7f58a93c7640 1 -- 172.21.15.17:0/3260833938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58a40683c0 con 0x7f58a4149090 2024-04-17T02:22:02.140 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:22:02.139+0000 7fa65242b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-17T02:22:02.140 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:22:02.139+0000 7fc978c11040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-17T02:22:02.141 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.136+0000 7f588b7fe640 1 -- 172.21.15.17:0/3260833938 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f5898021070 con 0x7f58a4149090 2024-04-17T02:22:02.200 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.199+0000 7f58a93c7640 1 -- 172.21.15.17:0/3260833938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f58a40a5040 con 0x7f58a4149090 2024-04-17T02:22:02.200 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.200+0000 7f588b7fe640 1 -- 172.21.15.17:0/3260833938 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f5898007570 con 0x7f58a4149090 2024-04-17T02:22:02.200 INFO:teuthology.misc.health.smithi017.stdout: 2024-04-17T02:22:02.201 INFO:teuthology.misc.health.smithi017.stdout:{"epoch":6,"fsid":"7cbfae20-b10d-41da-92b7-cbd5c1632e23","created":"2024-04-17T02:22:00.246446+0000","modified":"2024-04-17T02:22:01.415384+0000","last_up_change":"0.000000","last_in_change":"2024-04-17T02:22:01.415384+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2973665c-6c5e-4688-bffe-72d3bdcf467f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a59a034d-19b4-47e8-8ca5-538597b4af1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"070f4c5f-459f-46ff-b980-05b1ac50c951","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"96216a49-a7b6-40eb-bc93-cc8c78a5270a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T02:22:02.201 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.200+0000 7f58a93c7640 10 mgrc shutdown 2024-04-17T02:22:02.202 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.200+0000 7f58a93c7640 1 -- 172.21.15.17:0/3260833938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58a4149090 msgr2=0x7f58a40702d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:02.202 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.200+0000 7f58a93c7640 1 --2- 172.21.15.17:0/3260833938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58a4149090 0x7f58a40702d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5898000f60 tx=0x7f5898001e70 comp rx=0 tx=0).stop 2024-04-17T02:22:02.202 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.200+0000 7f58a93c7640 1 -- 172.21.15.17:0/3260833938 shutdown_connections 2024-04-17T02:22:02.202 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.200+0000 7f58a93c7640 1 --2- 172.21.15.17:0/3260833938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58a4149090 0x7f58a40702d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:02.202 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.200+0000 7f58a93c7640 1 --2- 172.21.15.17:0/3260833938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58a414d9e0 0x7f58a40a2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:02.202 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.200+0000 7f58a93c7640 1 --2- 172.21.15.17:0/3260833938 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f58a40a5530 0x7f58a41435e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:02.202 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.200+0000 7f58a93c7640 1 -- 172.21.15.17:0/3260833938 >> 172.21.15.17:0/3260833938 conn(0x7f58a40a7550 msgr2=0x7f58a40b4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:02.202 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.200+0000 7f58a93c7640 1 -- 172.21.15.17:0/3260833938 shutdown_connections 2024-04-17T02:22:02.202 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:02.201+0000 7f58a93c7640 1 -- 172.21.15.17:0/3260833938 wait complete. 2024-04-17T02:22:02.210 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-04-17T02:22:02.300 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:22:02.299+0000 7f2a73a0f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-17T02:22:02.441 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:22:02.440+0000 7f2a73a0f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-17T02:22:02.538 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:22:02.537+0000 7fc978c11040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-17T02:22:02.538 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:22:02.537+0000 7fa65242b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-17T02:22:02.570 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:22:02.569+0000 7f2a73a0f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-17T02:22:02.617 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:22:02.616+0000 7f2a73a0f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-17T02:22:02.678 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:22:02.677+0000 7fa65242b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-17T02:22:02.678 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:22:02.677+0000 7fc978c11040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-17T02:22:02.732 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:22:02.732+0000 7f2a73a0f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-17T02:22:02.798 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:22:02.797+0000 7fa65242b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-17T02:22:02.798 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:22:02.797+0000 7fc978c11040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-17T02:22:02.831 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:22:02.830+0000 7f2a73a0f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-17T02:22:02.845 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:22:02.844+0000 7fc978c11040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-17T02:22:02.845 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:22:02.845+0000 7fa65242b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-17T02:22:02.962 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:22:02.961+0000 7fa65242b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-17T02:22:02.962 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:22:02.962+0000 7fc978c11040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-17T02:22:02.990 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:22:02.989+0000 7f2a73a0f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-17T02:22:03.034 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:22:03.033+0000 7f2a73a0f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-17T02:22:03.061 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:22:03.061+0000 7fa65242b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-17T02:22:03.062 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:22:03.061+0000 7fc978c11040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-17T02:22:03.195 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:22:03.194+0000 7f2a73a0f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-17T02:22:03.223 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:22:03.222+0000 7fa65242b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-17T02:22:03.224 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:22:03.222+0000 7fc978c11040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-17T02:22:03.267 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:22:03.267+0000 7fa65242b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-17T02:22:03.268 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:22:03.267+0000 7fc978c11040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-17T02:22:03.430 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:22:03.429+0000 7fa65242b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-17T02:22:03.430 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:22:03.429+0000 7fc978c11040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-17T02:22:04.036 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:22:04.035+0000 7f2a73a0f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-17T02:22:04.265 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:22:04.264+0000 7fa65242b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-17T02:22:04.265 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:22:04.264+0000 7fc978c11040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-17T02:22:04.320 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:22:04.320+0000 7f2a73a0f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-17T02:22:04.350 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T02:22:04.353 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T02:22:04.374 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:22:04.373+0000 7f2a73a0f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-17T02:22:04.495 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:22:04.494+0000 7f2a73a0f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-17T02:22:04.551 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:22:04.550+0000 7fa65242b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-17T02:22:04.556 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:22:04.555+0000 7fc978c11040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-17T02:22:04.604 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:22:04.603+0000 7fa65242b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-17T02:22:04.606 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:22:04.605+0000 7fc978c11040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-17T02:22:04.721 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:22:04.719+0000 7fa65242b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-17T02:22:04.721 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:22:04.721+0000 7fc978c11040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-17T02:22:05.513 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:22:05.512+0000 7f2a1425e640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-17T02:22:05.513 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:22:05.512+0000 7f2a1425e640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-17T02:22:05.520 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-04-17T02:22:05.519+0000 7faa2840c640 -1 osd.0 0 log_to_monitors true 2024-04-17T02:22:05.529 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-04-17T02:22:05.528+0000 7fe506617640 -1 osd.3 0 log_to_monitors true 2024-04-17T02:22:05.556 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-04-17T02:22:05.555+0000 7fe0b4581640 -1 osd.1 0 log_to_monitors true 2024-04-17T02:22:05.582 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-17T02:22:05.581+0000 7fb906099640 -1 osd.2 0 log_to_monitors true 2024-04-17T02:22:08.078 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-04-17T02:22:08.075+0000 7faa244b6640 -1 osd.0 0 waiting for initial osdmap 2024-04-17T02:22:08.092 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-04-17T02:22:08.091+0000 7faa1bac2640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T02:22:08.353 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-04-17T02:22:08.352+0000 7fe0b0517640 -1 osd.1 0 waiting for initial osdmap 2024-04-17T02:22:08.362 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-04-17T02:22:08.362+0000 7fe0a8337640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T02:22:08.392 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-04-17T02:22:08.391+0000 7fe502800640 -1 osd.3 0 waiting for initial osdmap 2024-04-17T02:22:08.402 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-04-17T02:22:08.401+0000 7fe4f9e0c640 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T02:22:08.419 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-17T02:22:08.418+0000 7fb902843640 -1 osd.2 0 waiting for initial osdmap 2024-04-17T02:22:08.429 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-17T02:22:08.428+0000 7fb8f9e4f640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T02:22:08.617 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-17T02:22:08.712 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.709+0000 7f91815d0640 1 Processor -- start 2024-04-17T02:22:08.712 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.709+0000 7f91815d0640 1 -- start start 2024-04-17T02:22:08.713 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.710+0000 7f91815d0640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f917c0a5ff0 0x7f917c0a7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:08.713 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.710+0000 7f91815d0640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f917c06fff0 0x7f917c145820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:08.713 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.710+0000 7f91815d0640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f917c06f400 0x7f917c145d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:08.713 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.710+0000 7f91815d0640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f917c073290 con 0x7f917c06fff0 2024-04-17T02:22:08.713 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.710+0000 7f91815d0640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f917c145560 con 0x7f917c0a5ff0 2024-04-17T02:22:08.713 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.710+0000 7f91815d0640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f917c145230 con 0x7f917c06f400 2024-04-17T02:22:08.713 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.710+0000 7f917a7fc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f917c06fff0 0x7f917c145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:08.713 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.710+0000 7f917b7fe640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f917c06f400 0x7f917c145d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:08.713 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.710+0000 7f917a7fc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f917c06fff0 0x7f917c145820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59240/0 (socket says 172.21.15.17:59240) 2024-04-17T02:22:08.713 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.710+0000 7f917b7fe640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f917c06f400 0x7f917c145d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:35320/0 (socket says 172.21.15.17:35320) 2024-04-17T02:22:08.713 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.710+0000 7f917a7fc640 1 -- 172.21.15.17:0/2273825879 learned_addr learned my addr 172.21.15.17:0/2273825879 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:08.713 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.710+0000 7f917affd640 1 --2- 172.21.15.17:0/2273825879 >> v2:172.21.15.122:3300/0 conn(0x7f917c0a5ff0 0x7f917c0a7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:08.713 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.710+0000 7f917b7fe640 1 -- 172.21.15.17:0/2273825879 >> v2:172.21.15.122:3300/0 conn(0x7f917c0a5ff0 msgr2=0x7f917c0a7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:08.714 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.710+0000 7f917b7fe640 1 --2- 172.21.15.17:0/2273825879 >> v2:172.21.15.122:3300/0 conn(0x7f917c0a5ff0 0x7f917c0a7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:08.714 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.710+0000 7f917b7fe640 1 -- 172.21.15.17:0/2273825879 >> v2:172.21.15.17:3300/0 conn(0x7f917c06fff0 msgr2=0x7f917c145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:08.714 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.710+0000 7f917b7fe640 1 --2- 172.21.15.17:0/2273825879 >> v2:172.21.15.17:3300/0 conn(0x7f917c06fff0 0x7f917c145820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:08.714 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.710+0000 7f917b7fe640 1 -- 172.21.15.17:0/2273825879 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f917c0a63d0 con 0x7f917c06f400 2024-04-17T02:22:08.714 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.710+0000 7f917a7fc640 1 --2- 172.21.15.17:0/2273825879 >> v2:172.21.15.17:3300/0 conn(0x7f917c06fff0 0x7f917c145820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:08.714 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.711+0000 7f917b7fe640 1 --2- 172.21.15.17:0/2273825879 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f917c06f400 0x7f917c145d60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f917c0a89e0 tx=0x7f917402bd90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bf56aec2aa84c32 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:08.714 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.711+0000 7f9179ffb640 1 -- 172.21.15.17:0/2273825879 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9174039070 con 0x7f917c06f400 2024-04-17T02:22:08.714 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.711+0000 7f9179ffb640 1 -- 172.21.15.17:0/2273825879 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f917402cb40 con 0x7f917c06f400 2024-04-17T02:22:08.714 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.711+0000 7f9179ffb640 1 -- 172.21.15.17:0/2273825879 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9174034440 con 0x7f917c06f400 2024-04-17T02:22:08.714 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.711+0000 7f91815d0640 1 -- 172.21.15.17:0/2273825879 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f917c06f400 msgr2=0x7f917c145d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:08.714 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.711+0000 7f91815d0640 1 --2- 172.21.15.17:0/2273825879 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f917c06f400 0x7f917c145d60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f917c0a89e0 tx=0x7f917402bd90 comp rx=0 tx=0).stop 2024-04-17T02:22:08.714 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.711+0000 7f91815d0640 1 -- 172.21.15.17:0/2273825879 shutdown_connections 2024-04-17T02:22:08.714 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.712+0000 7f91815d0640 1 --2- 172.21.15.17:0/2273825879 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f917c06f400 0x7f917c145d60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:08.714 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.712+0000 7f91815d0640 1 --2- 172.21.15.17:0/2273825879 >> v2:172.21.15.17:3300/0 conn(0x7f917c06fff0 0x7f917c145820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:08.714 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.712+0000 7f91815d0640 1 --2- 172.21.15.17:0/2273825879 >> v2:172.21.15.122:3300/0 conn(0x7f917c0a5ff0 0x7f917c0a7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:08.715 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.712+0000 7f91815d0640 1 -- 172.21.15.17:0/2273825879 >> 172.21.15.17:0/2273825879 conn(0x7f917c06bb70 msgr2=0x7f917c0a7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:08.715 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.712+0000 7f91815d0640 1 -- 172.21.15.17:0/2273825879 shutdown_connections 2024-04-17T02:22:08.715 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.712+0000 7f91815d0640 1 -- 172.21.15.17:0/2273825879 wait complete. 2024-04-17T02:22:08.718 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.713+0000 7f91815d0640 1 Processor -- start 2024-04-17T02:22:08.718 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.713+0000 7f91815d0640 1 -- start start 2024-04-17T02:22:08.718 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.713+0000 7f91815d0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f917c06f400 0x7f917c0a1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:08.718 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.713+0000 7f91815d0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f917c06fff0 0x7f917c1daac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:08.718 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.713+0000 7f91815d0640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f917c0a5ff0 0x7f917c1db000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:08.718 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.713+0000 7f91815d0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f917c0a7920 con 0x7f917c06fff0 2024-04-17T02:22:08.718 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.713+0000 7f91815d0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f917c0a77a0 con 0x7f917c06f400 2024-04-17T02:22:08.718 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.713+0000 7f91815d0640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f917c1db700 con 0x7f917c0a5ff0 2024-04-17T02:22:08.718 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.713+0000 7f917a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f917c06fff0 0x7f917c1daac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:08.718 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.713+0000 7f917b7fe640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f917c0a5ff0 0x7f917c1db000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:08.718 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.713+0000 7f917a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f917c06fff0 0x7f917c1daac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59246/0 (socket says 172.21.15.17:59246) 2024-04-17T02:22:08.718 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.713+0000 7f917b7fe640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f917c0a5ff0 0x7f917c1db000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:35334/0 (socket says 172.21.15.17:35334) 2024-04-17T02:22:08.719 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.713+0000 7f917a7fc640 1 -- 172.21.15.17:0/2256334767 learned_addr learned my addr 172.21.15.17:0/2256334767 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:08.719 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.714+0000 7f917affd640 1 --2- 172.21.15.17:0/2256334767 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f917c06f400 0x7f917c0a1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:08.719 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.714+0000 7f917b7fe640 1 -- 172.21.15.17:0/2256334767 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f917c06f400 msgr2=0x7f917c0a1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:08.719 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.714+0000 7f917b7fe640 1 --2- 172.21.15.17:0/2256334767 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f917c06f400 0x7f917c0a1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:08.719 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.714+0000 7f917b7fe640 1 -- 172.21.15.17:0/2256334767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f917c06fff0 msgr2=0x7f917c1daac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:08.719 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.714+0000 7f917b7fe640 1 --2- 172.21.15.17:0/2256334767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f917c06fff0 0x7f917c1daac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:08.719 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.714+0000 7f917b7fe640 1 -- 172.21.15.17:0/2256334767 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f917c1db9c0 con 0x7f917c0a5ff0 2024-04-17T02:22:08.719 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.714+0000 7f917affd640 1 --2- 172.21.15.17:0/2256334767 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f917c06f400 0x7f917c0a1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T02:22:08.719 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.714+0000 7f917b7fe640 1 --2- 172.21.15.17:0/2256334767 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f917c0a5ff0 0x7f917c1db000 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9174033000 tx=0x7f9174004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:08.719 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.714+0000 7f91737fe640 1 -- 172.21.15.17:0/2256334767 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9174039050 con 0x7f917c0a5ff0 2024-04-17T02:22:08.719 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.714+0000 7f91737fe640 1 -- 172.21.15.17:0/2256334767 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9174045070 con 0x7f917c0a5ff0 2024-04-17T02:22:08.719 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.714+0000 7f91815d0640 1 -- 172.21.15.17:0/2256334767 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f917c0a0a20 con 0x7f917c0a5ff0 2024-04-17T02:22:08.719 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.714+0000 7f91737fe640 1 -- 172.21.15.17:0/2256334767 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9174009450 con 0x7f917c0a5ff0 2024-04-17T02:22:08.719 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.714+0000 7f91815d0640 1 -- 172.21.15.17:0/2256334767 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f917c0a5080 con 0x7f917c0a5ff0 2024-04-17T02:22:08.719 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.715+0000 7f91815d0640 1 -- 172.21.15.17:0/2256334767 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f917c0689a0 con 0x7f917c0a5ff0 2024-04-17T02:22:08.720 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.716+0000 7f91737fe640 1 -- 172.21.15.17:0/2256334767 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 4) ==== 134861+0+0 (secure 0 0 0) 0x7f917403e850 con 0x7f917c0a5ff0 2024-04-17T02:22:08.720 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.716+0000 7f91737fe640 20 mgrc handle_mgr_map mgrmap(e 4) 2024-04-17T02:22:08.720 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.717+0000 7f91737fe640 4 mgrc handle_mgr_map Got map version 4 2024-04-17T02:22:08.720 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.717+0000 7f91737fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:08.720 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.717+0000 7f91737fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:08.720 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.717+0000 7f91737fe640 1 --2- 172.21.15.17:0/2256334767 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f915c09f420 0x7f915c0a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:08.720 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.717+0000 7f917affd640 1 --2- 172.21.15.17:0/2256334767 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f915c09f420 0x7f915c0a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:08.720 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.717+0000 7f91737fe640 1 -- 172.21.15.17:0/2256334767 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1623+0+0 (secure 0 0 0) 0x7f91740eb2f0 con 0x7f917c0a5ff0 2024-04-17T02:22:08.720 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.717+0000 7f917affd640 1 --2- 172.21.15.17:0/2256334767 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f915c09f420 0x7f915c0a18e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f916c009a20 tx=0x7f916c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:08.722 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.721+0000 7f91737fe640 1 -- 172.21.15.17:0/2256334767 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f91740bb070 con 0x7f917c0a5ff0 2024-04-17T02:22:08.903 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.902+0000 7f91815d0640 1 -- 172.21.15.17:0/2256334767 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f917c0a5320 con 0x7f917c0a5ff0 2024-04-17T02:22:08.904 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.903+0000 7f91737fe640 1 -- 172.21.15.17:0/2256334767 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+4153 (secure 0 0 0) 0x7f91740ba970 con 0x7f917c0a5ff0 2024-04-17T02:22:08.904 INFO:teuthology.misc.health.smithi017.stdout: 2024-04-17T02:22:08.904 INFO:teuthology.misc.health.smithi017.stdout:{"epoch":8,"fsid":"7cbfae20-b10d-41da-92b7-cbd5c1632e23","created":"2024-04-17T02:22:00.246446+0000","modified":"2024-04-17T02:22:07.504570+0000","last_up_change":"0.000000","last_in_change":"2024-04-17T02:22:01.415384+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2973665c-6c5e-4688-bffe-72d3bdcf467f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a59a034d-19b4-47e8-8ca5-538597b4af1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"070f4c5f-459f-46ff-b980-05b1ac50c951","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"96216a49-a7b6-40eb-bc93-cc8c78a5270a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T02:22:08.906 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.905+0000 7f91815d0640 10 mgrc shutdown 2024-04-17T02:22:08.906 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.905+0000 7f91815d0640 1 -- 172.21.15.17:0/2256334767 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f915c09f420 msgr2=0x7f915c0a18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:08.906 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.905+0000 7f91815d0640 1 --2- 172.21.15.17:0/2256334767 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f915c09f420 0x7f915c0a18e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f916c009a20 tx=0x7f916c008040 comp rx=0 tx=0).stop 2024-04-17T02:22:08.906 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.905+0000 7f91815d0640 1 -- 172.21.15.17:0/2256334767 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f917c0a5ff0 msgr2=0x7f917c1db000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:08.906 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.905+0000 7f91815d0640 1 --2- 172.21.15.17:0/2256334767 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f917c0a5ff0 0x7f917c1db000 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9174033000 tx=0x7f9174004a40 comp rx=0 tx=0).stop 2024-04-17T02:22:08.906 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.905+0000 7f91815d0640 1 -- 172.21.15.17:0/2256334767 shutdown_connections 2024-04-17T02:22:08.906 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.905+0000 7f91815d0640 1 --2- 172.21.15.17:0/2256334767 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f915c09f420 0x7f915c0a18e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:08.907 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.905+0000 7f91815d0640 1 --2- 172.21.15.17:0/2256334767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f917c06fff0 0x7f917c1daac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:08.907 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.905+0000 7f91815d0640 1 --2- 172.21.15.17:0/2256334767 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f917c0a5ff0 0x7f917c1db000 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:08.907 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.905+0000 7f91815d0640 1 --2- 172.21.15.17:0/2256334767 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f917c06f400 0x7f917c0a1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:08.907 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.905+0000 7f91815d0640 1 -- 172.21.15.17:0/2256334767 >> 172.21.15.17:0/2256334767 conn(0x7f917c06bb70 msgr2=0x7f917c0b7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:08.907 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.905+0000 7f91815d0640 1 -- 172.21.15.17:0/2256334767 shutdown_connections 2024-04-17T02:22:08.907 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:08.905+0000 7f91815d0640 1 -- 172.21.15.17:0/2256334767 wait complete. 2024-04-17T02:22:08.915 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-04-17T02:22:15.319 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-17T02:22:15.423 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.422+0000 7fbf7f11c640 1 Processor -- start 2024-04-17T02:22:15.423 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.422+0000 7fbf7f11c640 1 -- start start 2024-04-17T02:22:15.425 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.422+0000 7fbf7f11c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbf780a63d0 0x7fbf78145ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:15.425 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.422+0000 7fbf7f11c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fbf780a0a70 0x7fbf780a3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:15.425 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.423+0000 7fbf7f11c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf780a1090 con 0x7fbf780a0650 2024-04-17T02:22:15.425 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.423+0000 7fbf7f11c640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fbf780a67b0 con 0x7fbf780a63d0 2024-04-17T02:22:15.425 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.423+0000 7fbf7f11c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fbf780a4e40 con 0x7fbf780a0a70 2024-04-17T02:22:15.425 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.423+0000 7fbf7ceb8640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbf780a63d0 0x7fbf78145ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:15.425 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.423+0000 7fbf7ceb8640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbf780a63d0 0x7fbf78145ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51316/0 (socket says 172.21.15.17:51316) 2024-04-17T02:22:15.425 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.423+0000 7fbf7ceb8640 1 -- 172.21.15.17:0/1709340488 learned_addr learned my addr 172.21.15.17:0/1709340488 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:15.426 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.423+0000 7fbf7d6b9640 1 --2- 172.21.15.17:0/1709340488 >> v2:172.21.15.122:3300/0 conn(0x7fbf780a0a70 0x7fbf780a3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:15.426 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.423+0000 7fbf7ceb8640 1 -- 172.21.15.17:0/1709340488 >> v2:172.21.15.122:3300/0 conn(0x7fbf780a0a70 msgr2=0x7fbf780a3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:15.426 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.423+0000 7fbf7ceb8640 1 --2- 172.21.15.17:0/1709340488 >> v2:172.21.15.122:3300/0 conn(0x7fbf780a0a70 0x7fbf780a3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:15.426 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.423+0000 7fbf7ceb8640 1 -- 172.21.15.17:0/1709340488 >> v1:172.21.15.122:6789/0 conn(0x7fbf780a0650 legacy=0x7fbf780a3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:15.426 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.423+0000 7fbf7ceb8640 1 -- 172.21.15.17:0/1709340488 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf78145360 con 0x7fbf780a63d0 2024-04-17T02:22:15.426 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.424+0000 7fbf7ceb8640 1 --2- 172.21.15.17:0/1709340488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf780a63d0 0x7fbf78145ab0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbf78145530 tx=0x7fbf6c02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4917d17e514db78 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:15.426 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.424+0000 7fbf777fe640 1 -- 172.21.15.17:0/1709340488 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c038070 con 0x7fbf780a63d0 2024-04-17T02:22:15.426 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.424+0000 7fbf777fe640 1 -- 172.21.15.17:0/1709340488 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf6c02f050 con 0x7fbf780a63d0 2024-04-17T02:22:15.426 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.424+0000 7fbf777fe640 1 -- 172.21.15.17:0/1709340488 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c031970 con 0x7fbf780a63d0 2024-04-17T02:22:15.426 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.424+0000 7fbf7f11c640 1 -- 172.21.15.17:0/1709340488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf780a63d0 msgr2=0x7fbf78145ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:15.426 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.424+0000 7fbf7f11c640 1 --2- 172.21.15.17:0/1709340488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf780a63d0 0x7fbf78145ab0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbf78145530 tx=0x7fbf6c02b7f0 comp rx=0 tx=0).stop 2024-04-17T02:22:15.429 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.425+0000 7fbf7f11c640 1 -- 172.21.15.17:0/1709340488 shutdown_connections 2024-04-17T02:22:15.429 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.425+0000 7fbf7f11c640 1 --2- 172.21.15.17:0/1709340488 >> v2:172.21.15.122:3300/0 conn(0x7fbf780a0a70 0x7fbf780a3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:15.429 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.425+0000 7fbf7f11c640 1 --2- 172.21.15.17:0/1709340488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf780a63d0 0x7fbf78145ab0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:15.429 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.425+0000 7fbf7f11c640 1 -- 172.21.15.17:0/1709340488 >> 172.21.15.17:0/1709340488 conn(0x7fbf7806b7c0 msgr2=0x7fbf780a5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:15.429 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.425+0000 7fbf7f11c640 1 -- 172.21.15.17:0/1709340488 shutdown_connections 2024-04-17T02:22:15.429 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.425+0000 7fbf7f11c640 1 -- 172.21.15.17:0/1709340488 wait complete. 2024-04-17T02:22:15.429 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.426+0000 7fbf7f11c640 1 Processor -- start 2024-04-17T02:22:15.429 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.426+0000 7fbf7f11c640 1 -- start start 2024-04-17T02:22:15.429 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.426+0000 7fbf7f11c640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fbf780a0650 0x7fbf7806c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:15.430 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.426+0000 7fbf7f11c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf780a0a70 0x7fbf78140610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:15.430 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.426+0000 7fbf7f11c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbf780a63d0 0x7fbf78140b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:15.430 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.427+0000 7fbf7f11c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbf780a8630 con 0x7fbf780a0a70 2024-04-17T02:22:15.430 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.427+0000 7fbf7f11c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbf780a8c80 con 0x7fbf780a63d0 2024-04-17T02:22:15.430 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.427+0000 7fbf7f11c640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fbf781414c0 con 0x7fbf780a0650 2024-04-17T02:22:15.430 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.427+0000 7fbf77fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf780a0a70 0x7fbf78140610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:15.430 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.427+0000 7fbf7ceb8640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fbf780a0650 0x7fbf7806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:15.430 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.427+0000 7fbf77fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf780a0a70 0x7fbf78140610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51326/0 (socket says 172.21.15.17:51326) 2024-04-17T02:22:15.430 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.427+0000 7fbf77fff640 1 -- 172.21.15.17:0/4100489819 learned_addr learned my addr 172.21.15.17:0/4100489819 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:15.430 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.427+0000 7fbf7ceb8640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fbf780a0650 0x7fbf7806c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:35112/0 (socket says 172.21.15.17:35112) 2024-04-17T02:22:15.430 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.427+0000 7fbf7d6b9640 1 --2- 172.21.15.17:0/4100489819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbf780a63d0 0x7fbf78140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:15.430 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.427+0000 7fbf77fff640 1 -- 172.21.15.17:0/4100489819 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fbf780a0650 msgr2=0x7fbf7806c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:15.430 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.427+0000 7fbf77fff640 1 --2- 172.21.15.17:0/4100489819 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fbf780a0650 0x7fbf7806c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:15.431 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.427+0000 7fbf77fff640 1 -- 172.21.15.17:0/4100489819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbf780a63d0 msgr2=0x7fbf78140b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:15.431 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.427+0000 7fbf77fff640 1 --2- 172.21.15.17:0/4100489819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbf780a63d0 0x7fbf78140b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:15.431 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.427+0000 7fbf77fff640 1 -- 172.21.15.17:0/4100489819 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf780ab370 con 0x7fbf780a0a70 2024-04-17T02:22:15.431 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.427+0000 7fbf77fff640 1 --2- 172.21.15.17:0/4100489819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf780a0a70 0x7fbf78140610 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbf6400c460 tx=0x7fbf6400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:15.431 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.427+0000 7fbf757fa640 1 -- 172.21.15.17:0/4100489819 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf64016020 con 0x7fbf780a0a70 2024-04-17T02:22:15.431 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.427+0000 7fbf757fa640 1 -- 172.21.15.17:0/4100489819 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf64012870 con 0x7fbf780a0a70 2024-04-17T02:22:15.431 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.427+0000 7fbf757fa640 1 -- 172.21.15.17:0/4100489819 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf64012c60 con 0x7fbf780a0a70 2024-04-17T02:22:15.431 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.427+0000 7fbf7f11c640 1 -- 172.21.15.17:0/4100489819 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf78141200 con 0x7fbf780a0a70 2024-04-17T02:22:15.431 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.427+0000 7fbf7f11c640 1 -- 172.21.15.17:0/4100489819 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf7806ce80 con 0x7fbf780a0a70 2024-04-17T02:22:15.431 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.428+0000 7fbf7f11c640 1 -- 172.21.15.17:0/4100489819 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf780aa790 con 0x7fbf780a0a70 2024-04-17T02:22:15.432 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.429+0000 7fbf757fa640 1 -- 172.21.15.17:0/4100489819 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7fbf64019020 con 0x7fbf780a0a70 2024-04-17T02:22:15.432 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.429+0000 7fbf757fa640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:15.432 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.430+0000 7fbf757fa640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:15.432 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.430+0000 7fbf757fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:15.432 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.430+0000 7fbf757fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:15.432 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.430+0000 7fbf757fa640 1 --2- 172.21.15.17:0/4100489819 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fbf5c09f4b0 0x7fbf5c0a1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:15.432 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.430+0000 7fbf7ceb8640 1 --2- 172.21.15.17:0/4100489819 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fbf5c09f4b0 0x7fbf5c0a1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:15.433 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.431+0000 7fbf757fa640 1 -- 172.21.15.17:0/4100489819 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3129+0+0 (secure 0 0 0) 0x7fbf640c9690 con 0x7fbf780a0a70 2024-04-17T02:22:15.433 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.431+0000 7fbf7ceb8640 1 --2- 172.21.15.17:0/4100489819 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fbf5c09f4b0 0x7fbf5c0a1970 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c035000 tx=0x7fbf6c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:15.435 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.434+0000 7fbf757fa640 1 -- 172.21.15.17:0/4100489819 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fbf64020020 con 0x7fbf780a0a70 2024-04-17T02:22:15.620 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.619+0000 7fbf7f11c640 1 -- 172.21.15.17:0/4100489819 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbf780689a0 con 0x7fbf780a0a70 2024-04-17T02:22:15.621 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.620+0000 7fbf757fa640 1 -- 172.21.15.17:0/4100489819 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7963 (secure 0 0 0) 0x7fbf780ab370 con 0x7fbf780a0a70 2024-04-17T02:22:15.621 INFO:teuthology.misc.health.smithi017.stdout: 2024-04-17T02:22:15.621 INFO:teuthology.misc.health.smithi017.stdout:{"epoch":13,"fsid":"7cbfae20-b10d-41da-92b7-cbd5c1632e23","created":"2024-04-17T02:22:00.246446+0000","modified":"2024-04-17T02:22:13.099284+0000","last_up_change":"2024-04-17T02:22:09.077928+0000","last_in_change":"2024-04-17T02:22:01.415384+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T02:22:10.533377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2973665c-6c5e-4688-bffe-72d3bdcf467f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6801","nonce":1828284343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6803","nonce":1828284343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6807","nonce":1828284343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6805","nonce":1828284343}]},"public_addr":"172.21.15.17:6801/1828284343","cluster_addr":"172.21.15.17:6803/1828284343","heartbeat_back_addr":"172.21.15.17:6807/1828284343","heartbeat_front_addr":"172.21.15.17:6805/1828284343","state":["exists","up"]},{"osd":1,"uuid":"a59a034d-19b4-47e8-8ca5-538597b4af1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6809","nonce":2064593011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6811","nonce":2064593011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6815","nonce":2064593011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6813","nonce":2064593011}]},"public_addr":"172.21.15.122:6809/2064593011","cluster_addr":"172.21.15.122:6811/2064593011","heartbeat_back_addr":"172.21.15.122:6815/2064593011","heartbeat_front_addr":"172.21.15.122:6813/2064593011","state":["exists","up"]},{"osd":2,"uuid":"070f4c5f-459f-46ff-b980-05b1ac50c951","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6817","nonce":929092547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6819","nonce":929092547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6823","nonce":929092547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6821","nonce":929092547}]},"public_addr":"172.21.15.122:6817/929092547","cluster_addr":"172.21.15.122:6819/929092547","heartbeat_back_addr":"172.21.15.122:6823/929092547","heartbeat_front_addr":"172.21.15.122:6821/929092547","state":["exists","up"]},{"osd":3,"uuid":"96216a49-a7b6-40eb-bc93-cc8c78a5270a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6801","nonce":204132523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6803","nonce":204132523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6807","nonce":204132523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6805","nonce":204132523}]},"public_addr":"172.21.15.122:6801/204132523","cluster_addr":"172.21.15.122:6803/204132523","heartbeat_back_addr":"172.21.15.122:6807/204132523","heartbeat_front_addr":"172.21.15.122:6805/204132523","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.477173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.522791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.590625+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.480698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T02:22:15.624 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.622+0000 7fbf7f11c640 10 mgrc shutdown 2024-04-17T02:22:15.624 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.622+0000 7fbf7f11c640 1 -- 172.21.15.17:0/4100489819 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fbf5c09f4b0 msgr2=0x7fbf5c0a1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:15.624 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.622+0000 7fbf7f11c640 1 --2- 172.21.15.17:0/4100489819 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fbf5c09f4b0 0x7fbf5c0a1970 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c035000 tx=0x7fbf6c008030 comp rx=0 tx=0).stop 2024-04-17T02:22:15.624 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.622+0000 7fbf7f11c640 1 -- 172.21.15.17:0/4100489819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf780a0a70 msgr2=0x7fbf78140610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:15.624 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.622+0000 7fbf7f11c640 1 --2- 172.21.15.17:0/4100489819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf780a0a70 0x7fbf78140610 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbf6400c460 tx=0x7fbf6400c920 comp rx=0 tx=0).stop 2024-04-17T02:22:15.624 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.623+0000 7fbf7f11c640 1 -- 172.21.15.17:0/4100489819 shutdown_connections 2024-04-17T02:22:15.624 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.623+0000 7fbf7f11c640 1 --2- 172.21.15.17:0/4100489819 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fbf5c09f4b0 0x7fbf5c0a1970 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:15.624 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.623+0000 7fbf7f11c640 1 --2- 172.21.15.17:0/4100489819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf780a0a70 0x7fbf78140610 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:15.624 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.623+0000 7fbf7f11c640 1 --2- 172.21.15.17:0/4100489819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbf780a63d0 0x7fbf78140b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:15.625 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.623+0000 7fbf7f11c640 1 --2- 172.21.15.17:0/4100489819 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fbf780a0650 0x7fbf7806c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:15.625 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.623+0000 7fbf7f11c640 1 -- 172.21.15.17:0/4100489819 >> 172.21.15.17:0/4100489819 conn(0x7fbf7806b7c0 msgr2=0x7fbf780a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:15.625 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.623+0000 7fbf7f11c640 1 -- 172.21.15.17:0/4100489819 shutdown_connections 2024-04-17T02:22:15.625 INFO:teuthology.misc.health.smithi017.stderr:2024-04-17T02:22:15.623+0000 7fbf7f11c640 1 -- 172.21.15.17:0/4100489819 wait complete. 2024-04-17T02:22:15.633 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-04-17T02:22:15.633 INFO:tasks.ceph:Creating RBD pool 2024-04-17T02:22:15.634 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-17T02:22:15.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.736+0000 7f6b7a63f640 1 Processor -- start 2024-04-17T02:22:15.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.736+0000 7f6b7a63f640 1 -- start start 2024-04-17T02:22:15.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.737+0000 7f6b7a63f640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6b740ab3b0 0x7f6b740ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:15.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.737+0000 7f6b7a63f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6b740a9560 0x7f6b74145730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:15.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.737+0000 7f6b7a63f640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b740a7f00 con 0x7f6b740acce0 2024-04-17T02:22:15.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.737+0000 7f6b7a63f640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f6b740abd20 con 0x7f6b740a9560 2024-04-17T02:22:15.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.737+0000 7f6b7a63f640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f6b740ac000 con 0x7f6b740ab3b0 2024-04-17T02:22:15.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.737+0000 7f6b6bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6b740a9560 0x7f6b74145730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:15.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.737+0000 7f6b6bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6b740a9560 0x7f6b74145730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51332/0 (socket says 172.21.15.17:51332) 2024-04-17T02:22:15.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.737+0000 7f6b6bfff640 1 -- 172.21.15.17:0/2455131920 learned_addr learned my addr 172.21.15.17:0/2455131920 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:15.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.737+0000 7f6b78bdc640 1 --1- 172.21.15.17:0/2455131920 >> v1:172.21.15.17:6789/0 conn(0x7f6b740acce0 0x7f6b741485d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53794/0 (socket says 172.21.15.17:53794) 2024-04-17T02:22:15.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.737+0000 7f6b73fff640 1 --2- 172.21.15.17:0/2455131920 >> v2:172.21.15.122:3300/0 conn(0x7f6b740ab3b0 0x7f6b740ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:15.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.737+0000 7f6b6bfff640 1 -- 172.21.15.17:0/2455131920 >> v2:172.21.15.122:3300/0 conn(0x7f6b740ab3b0 msgr2=0x7f6b740ac7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:15.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.737+0000 7f6b6bfff640 1 --2- 172.21.15.17:0/2455131920 >> v2:172.21.15.122:3300/0 conn(0x7f6b740ab3b0 0x7f6b740ac7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:15.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.737+0000 7f6b6bfff640 1 -- 172.21.15.17:0/2455131920 >> v1:172.21.15.17:6789/0 conn(0x7f6b740acce0 legacy=0x7f6b741485d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:15.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.738+0000 7f6b6bfff640 1 -- 172.21.15.17:0/2455131920 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b740a7960 con 0x7f6b740a9560 2024-04-17T02:22:15.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.738+0000 7f6b737fe640 1 -- 172.21.15.17:0/2455131920 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 745539151 0 0) 0x7f6b740a7f00 con 0x7f6b740acce0 2024-04-17T02:22:15.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.738+0000 7f6b73fff640 1 --2- 172.21.15.17:0/2455131920 >> v2:172.21.15.122:3300/0 conn(0x7f6b740ab3b0 0x7f6b740ac7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T02:22:15.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.738+0000 7f6b6bfff640 1 --2- 172.21.15.17:0/2455131920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b740a9560 0x7f6b74145730 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c009870 tx=0x7f6b5c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c089eee5bd21d4d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:15.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.738+0000 7f6b737fe640 1 -- 172.21.15.17:0/2455131920 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c035020 con 0x7f6b740a9560 2024-04-17T02:22:15.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.738+0000 7f6b737fe640 1 -- 172.21.15.17:0/2455131920 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b5c031870 con 0x7f6b740a9560 2024-04-17T02:22:15.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.739+0000 7f6b737fe640 1 -- 172.21.15.17:0/2455131920 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c031c40 con 0x7f6b740a9560 2024-04-17T02:22:15.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.739+0000 7f6b7a63f640 1 -- 172.21.15.17:0/2455131920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b740a9560 msgr2=0x7f6b74145730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:15.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.739+0000 7f6b7a63f640 1 --2- 172.21.15.17:0/2455131920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b740a9560 0x7f6b74145730 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c009870 tx=0x7f6b5c02b910 comp rx=0 tx=0).stop 2024-04-17T02:22:15.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.739+0000 7f6b7a63f640 1 -- 172.21.15.17:0/2455131920 shutdown_connections 2024-04-17T02:22:15.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.739+0000 7f6b7a63f640 1 --2- 172.21.15.17:0/2455131920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b740a9560 0x7f6b74145730 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:15.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.739+0000 7f6b7a63f640 1 --2- 172.21.15.17:0/2455131920 >> v2:172.21.15.122:3300/0 conn(0x7f6b740ab3b0 0x7f6b740ac7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:15.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.739+0000 7f6b7a63f640 1 -- 172.21.15.17:0/2455131920 >> 172.21.15.17:0/2455131920 conn(0x7f6b740a9b60 msgr2=0x7f6b740a9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:15.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.739+0000 7f6b7a63f640 1 -- 172.21.15.17:0/2455131920 shutdown_connections 2024-04-17T02:22:15.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.739+0000 7f6b7a63f640 1 -- 172.21.15.17:0/2455131920 wait complete. 2024-04-17T02:22:15.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.740+0000 7f6b7a63f640 1 Processor -- start 2024-04-17T02:22:15.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.740+0000 7f6b7a63f640 1 -- start start 2024-04-17T02:22:15.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.741+0000 7f6b7a63f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b740a9560 0x7f6b74148160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:15.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.741+0000 7f6b7a63f640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f6b740ab3b0 0x7f6b741dd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:15.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.741+0000 7f6b7a63f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b740acce0 0x7f6b741dde80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:15.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.741+0000 7f6b7a63f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7406b5b0 con 0x7f6b740acce0 2024-04-17T02:22:15.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.741+0000 7f6b7a63f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6b74145c70 con 0x7f6b740a9560 2024-04-17T02:22:15.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.741+0000 7f6b7a63f640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f6b740b1030 con 0x7f6b740ab3b0 2024-04-17T02:22:15.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.741+0000 7f6b78bdc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b740acce0 0x7f6b741dde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:15.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.741+0000 7f6b78bdc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b740acce0 0x7f6b741dde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51340/0 (socket says 172.21.15.17:51340) 2024-04-17T02:22:15.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.741+0000 7f6b6bfff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f6b740ab3b0 0x7f6b741dd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:15.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.741+0000 7f6b78bdc640 1 -- 172.21.15.17:0/1952660948 learned_addr learned my addr 172.21.15.17:0/1952660948 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:15.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.741+0000 7f6b73fff640 1 --2- 172.21.15.17:0/1952660948 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b740a9560 0x7f6b74148160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:15.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.741+0000 7f6b78bdc640 1 -- 172.21.15.17:0/1952660948 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f6b740ab3b0 msgr2=0x7f6b741dd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:15.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.741+0000 7f6b78bdc640 1 --2- 172.21.15.17:0/1952660948 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f6b740ab3b0 0x7f6b741dd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:15.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.741+0000 7f6b78bdc640 1 -- 172.21.15.17:0/1952660948 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b740a9560 msgr2=0x7f6b74148160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:15.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.741+0000 7f6b78bdc640 1 --2- 172.21.15.17:0/1952660948 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b740a9560 0x7f6b74148160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:15.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.741+0000 7f6b78bdc640 1 -- 172.21.15.17:0/1952660948 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b740b26b0 con 0x7f6b740acce0 2024-04-17T02:22:15.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.741+0000 7f6b78bdc640 1 --2- 172.21.15.17:0/1952660948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b740acce0 0x7f6b741dde80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c00c6d0 tx=0x7f6b6c00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:15.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.741+0000 7f6b717fa640 1 -- 172.21.15.17:0/1952660948 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c018070 con 0x7f6b740acce0 2024-04-17T02:22:15.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.742+0000 7f6b717fa640 1 -- 172.21.15.17:0/1952660948 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b6c004d60 con 0x7f6b740acce0 2024-04-17T02:22:15.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.742+0000 7f6b7a63f640 1 -- 172.21.15.17:0/1952660948 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b740ae1f0 con 0x7f6b740acce0 2024-04-17T02:22:15.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.742+0000 7f6b717fa640 1 -- 172.21.15.17:0/1952660948 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c00a820 con 0x7f6b740acce0 2024-04-17T02:22:15.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.742+0000 7f6b7a63f640 1 -- 172.21.15.17:0/1952660948 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b74140f30 con 0x7f6b740acce0 2024-04-17T02:22:15.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.742+0000 7f6b7a63f640 1 -- 172.21.15.17:0/1952660948 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b740687f0 con 0x7f6b740acce0 2024-04-17T02:22:15.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.743+0000 7f6b717fa640 1 -- 172.21.15.17:0/1952660948 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f6b6c01b070 con 0x7f6b740acce0 2024-04-17T02:22:15.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.743+0000 7f6b717fa640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:15.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.744+0000 7f6b717fa640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:15.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.744+0000 7f6b717fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:15.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.744+0000 7f6b717fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:15.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.744+0000 7f6b717fa640 1 --2- 172.21.15.17:0/1952660948 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f6b5409f480 0x7f6b540a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:15.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.744+0000 7f6b73fff640 1 --2- 172.21.15.17:0/1952660948 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f6b5409f480 0x7f6b540a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:15.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.744+0000 7f6b717fa640 1 -- 172.21.15.17:0/1952660948 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3129+0+0 (secure 0 0 0) 0x7f6b6c0c8620 con 0x7f6b740acce0 2024-04-17T02:22:15.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.745+0000 7f6b73fff640 1 --2- 172.21.15.17:0/1952660948 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f6b5409f480 0x7f6b540a1940 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6b6400ab60 tx=0x7f6b64008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:15.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.748+0000 7f6b717fa640 1 -- 172.21.15.17:0/1952660948 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f6b6c0974e0 con 0x7f6b740acce0 2024-04-17T02:22:15.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:15.928+0000 7f6b7a63f640 1 -- 172.21.15.17:0/1952660948 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f6b7406c250 con 0x7f6b740acce0 2024-04-17T02:22:16.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.111+0000 7f6b717fa640 1 -- 172.21.15.17:0/1952660948 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) ==== 109+0+0 (secure 0 0 0) 0x7f6b6c09b580 con 0x7f6b740acce0 2024-04-17T02:22:16.113 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'rbd' created 2024-04-17T02:22:16.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.115+0000 7f6b7a63f640 10 mgrc shutdown 2024-04-17T02:22:16.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.115+0000 7f6b7a63f640 1 -- 172.21.15.17:0/1952660948 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f6b5409f480 msgr2=0x7f6b540a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:16.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.115+0000 7f6b7a63f640 1 --2- 172.21.15.17:0/1952660948 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f6b5409f480 0x7f6b540a1940 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6b6400ab60 tx=0x7f6b64008040 comp rx=0 tx=0).stop 2024-04-17T02:22:16.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.115+0000 7f6b7a63f640 1 -- 172.21.15.17:0/1952660948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b740acce0 msgr2=0x7f6b741dde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:16.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.115+0000 7f6b7a63f640 1 --2- 172.21.15.17:0/1952660948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b740acce0 0x7f6b741dde80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c00c6d0 tx=0x7f6b6c00cb90 comp rx=0 tx=0).stop 2024-04-17T02:22:16.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.115+0000 7f6b7a63f640 1 -- 172.21.15.17:0/1952660948 shutdown_connections 2024-04-17T02:22:16.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.115+0000 7f6b7a63f640 1 --2- 172.21.15.17:0/1952660948 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f6b5409f480 0x7f6b540a1940 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:16.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.115+0000 7f6b7a63f640 1 --2- 172.21.15.17:0/1952660948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b740acce0 0x7f6b741dde80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:16.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.115+0000 7f6b7a63f640 1 --2- 172.21.15.17:0/1952660948 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f6b740ab3b0 0x7f6b741dd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:16.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.115+0000 7f6b7a63f640 1 --2- 172.21.15.17:0/1952660948 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b740a9560 0x7f6b74148160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:16.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.115+0000 7f6b7a63f640 1 -- 172.21.15.17:0/1952660948 >> 172.21.15.17:0/1952660948 conn(0x7f6b740a9b60 msgr2=0x7f6b740a9f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:16.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.115+0000 7f6b7a63f640 1 -- 172.21.15.17:0/1952660948 shutdown_connections 2024-04-17T02:22:16.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.115+0000 7f6b7a63f640 1 -- 172.21.15.17:0/1952660948 wait complete. 2024-04-17T02:22:16.127 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-17T02:22:16.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.232+0000 7f0824c8f640 1 Processor -- start 2024-04-17T02:22:16.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.232+0000 7f0824c8f640 1 -- start start 2024-04-17T02:22:16.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.232+0000 7f0824c8f640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f0820072930 0x7f08200a5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:16.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.232+0000 7f0824c8f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f082006d3b0 0x7f08200a5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:16.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.232+0000 7f0824c8f640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f082006c8c0 con 0x7f082006cfd0 2024-04-17T02:22:16.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.232+0000 7f0824c8f640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f08200a61f0 con 0x7f082006d3b0 2024-04-17T02:22:16.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.232+0000 7f0824c8f640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f082006cb80 con 0x7f0820072930 2024-04-17T02:22:16.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.232+0000 7f081ed9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f082006d3b0 0x7f08200a5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:16.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.233+0000 7f081ed9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f082006d3b0 0x7f08200a5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51350/0 (socket says 172.21.15.17:51350) 2024-04-17T02:22:16.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.233+0000 7f081ed9d640 1 -- 172.21.15.17:0/3547410750 learned_addr learned my addr 172.21.15.17:0/3547410750 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:16.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.233+0000 7f081dd9b640 1 --2- 172.21.15.17:0/3547410750 >> v2:172.21.15.122:3300/0 conn(0x7f0820072930 0x7f08200a5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:16.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.233+0000 7f081ed9d640 1 -- 172.21.15.17:0/3547410750 >> v2:172.21.15.122:3300/0 conn(0x7f0820072930 msgr2=0x7f08200a5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:16.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.233+0000 7f081ed9d640 1 --2- 172.21.15.17:0/3547410750 >> v2:172.21.15.122:3300/0 conn(0x7f0820072930 0x7f08200a5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:16.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.233+0000 7f081ed9d640 1 -- 172.21.15.17:0/3547410750 >> v1:172.21.15.17:6789/0 conn(0x7f082006cfd0 legacy=0x7f08200a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:16.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.233+0000 7f081ed9d640 1 -- 172.21.15.17:0/3547410750 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08200a75d0 con 0x7f082006d3b0 2024-04-17T02:22:16.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.233+0000 7f081d59a640 1 -- 172.21.15.17:0/3547410750 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2046436932 0 0) 0x7f082006c8c0 con 0x7f082006cfd0 2024-04-17T02:22:16.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.234+0000 7f081ed9d640 1 --2- 172.21.15.17:0/3547410750 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f082006d3b0 0x7f08200a5cb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f082006b4e0 tx=0x7f081002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05fae1f51c4e3a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:16.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.234+0000 7f081d59a640 1 -- 172.21.15.17:0/3547410750 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f081002e070 con 0x7f082006d3b0 2024-04-17T02:22:16.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.234+0000 7f081d59a640 1 -- 172.21.15.17:0/3547410750 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0810037070 con 0x7f082006d3b0 2024-04-17T02:22:16.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.234+0000 7f081d59a640 1 -- 172.21.15.17:0/3547410750 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0810031a00 con 0x7f082006d3b0 2024-04-17T02:22:16.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.234+0000 7f0824c8f640 1 -- 172.21.15.17:0/3547410750 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f082006d3b0 msgr2=0x7f08200a5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:16.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.234+0000 7f0824c8f640 1 --2- 172.21.15.17:0/3547410750 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f082006d3b0 0x7f08200a5cb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f082006b4e0 tx=0x7f081002b880 comp rx=0 tx=0).stop 2024-04-17T02:22:16.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.234+0000 7f0824c8f640 1 -- 172.21.15.17:0/3547410750 shutdown_connections 2024-04-17T02:22:16.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.234+0000 7f0824c8f640 1 --2- 172.21.15.17:0/3547410750 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f082006d3b0 0x7f08200a5cb0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:16.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.234+0000 7f0824c8f640 1 --2- 172.21.15.17:0/3547410750 >> v2:172.21.15.122:3300/0 conn(0x7f0820072930 0x7f08200a5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:16.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.234+0000 7f0824c8f640 1 -- 172.21.15.17:0/3547410750 >> 172.21.15.17:0/3547410750 conn(0x7f08200a7970 msgr2=0x7f08200a7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:16.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.234+0000 7f0824c8f640 1 -- 172.21.15.17:0/3547410750 shutdown_connections 2024-04-17T02:22:16.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.234+0000 7f0824c8f640 1 -- 172.21.15.17:0/3547410750 wait complete. 2024-04-17T02:22:16.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.235+0000 7f0824c8f640 1 Processor -- start 2024-04-17T02:22:16.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.236+0000 7f0824c8f640 1 -- start start 2024-04-17T02:22:16.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.236+0000 7f0824c8f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f082006cfd0 0x7f08201425e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:16.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.236+0000 7f0824c8f640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f082006d3b0 0x7f08200a3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:16.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.236+0000 7f0824c8f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0820072930 0x7f08201406f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:16.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.236+0000 7f0824c8f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f082014f920 con 0x7f0820072930 2024-04-17T02:22:16.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.236+0000 7f0824c8f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f082014f7a0 con 0x7f082006cfd0 2024-04-17T02:22:16.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.236+0000 7f0824c8f640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f082014faa0 con 0x7f082006d3b0 2024-04-17T02:22:16.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.236+0000 7f081ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0820072930 0x7f08201406f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:16.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.236+0000 7f081dd9b640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f082006d3b0 0x7f08200a3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:16.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.236+0000 7f081ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0820072930 0x7f08201406f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51352/0 (socket says 172.21.15.17:51352) 2024-04-17T02:22:16.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.236+0000 7f081ed9d640 1 -- 172.21.15.17:0/1336141385 learned_addr learned my addr 172.21.15.17:0/1336141385 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:16.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.236+0000 7f081e59c640 1 --2- 172.21.15.17:0/1336141385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f082006cfd0 0x7f08201425e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:16.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.237+0000 7f081dd9b640 1 -- 172.21.15.17:0/1336141385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f082006cfd0 msgr2=0x7f08201425e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:16.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.237+0000 7f081dd9b640 1 --2- 172.21.15.17:0/1336141385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f082006cfd0 0x7f08201425e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:16.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.237+0000 7f081dd9b640 1 -- 172.21.15.17:0/1336141385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0820072930 msgr2=0x7f08201406f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:16.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.237+0000 7f081dd9b640 1 --2- 172.21.15.17:0/1336141385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0820072930 0x7f08201406f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:16.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.237+0000 7f081dd9b640 1 -- 172.21.15.17:0/1336141385 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f082013ffe0 con 0x7f082006d3b0 2024-04-17T02:22:16.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.237+0000 7f081ed9d640 1 --2- 172.21.15.17:0/1336141385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0820072930 0x7f08201406f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:16.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.237+0000 7f081e59c640 1 --2- 172.21.15.17:0/1336141385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f082006cfd0 0x7f08201425e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T02:22:16.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.237+0000 7f081dd9b640 1 --2- 172.21.15.17:0/1336141385 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f082006d3b0 0x7f08200a3970 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f080800d5f0 tx=0x7f080800dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:16.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.237+0000 7f0816ffd640 1 -- 172.21.15.17:0/1336141385 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08080125f0 con 0x7f082006d3b0 2024-04-17T02:22:16.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.237+0000 7f0816ffd640 1 -- 172.21.15.17:0/1336141385 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0808019070 con 0x7f082006d3b0 2024-04-17T02:22:16.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.237+0000 7f0824c8f640 1 -- 172.21.15.17:0/1336141385 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08201402a0 con 0x7f082006d3b0 2024-04-17T02:22:16.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.237+0000 7f0816ffd640 1 -- 172.21.15.17:0/1336141385 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08080129d0 con 0x7f082006d3b0 2024-04-17T02:22:16.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.237+0000 7f0824c8f640 1 -- 172.21.15.17:0/1336141385 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f08201415b0 con 0x7f082006d3b0 2024-04-17T02:22:16.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.238+0000 7f0824c8f640 1 -- 172.21.15.17:0/1336141385 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0820068890 con 0x7f082006d3b0 2024-04-17T02:22:16.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.239+0000 7f0816ffd640 1 -- 172.21.15.17:0/1336141385 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f0808012b70 con 0x7f082006d3b0 2024-04-17T02:22:16.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.239+0000 7f0816ffd640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:16.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.239+0000 7f0816ffd640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:16.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.239+0000 7f0816ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:16.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.239+0000 7f0816ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:16.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.239+0000 7f0816ffd640 1 --2- 172.21.15.17:0/1336141385 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f080009f480 0x7f08000a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:16.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.240+0000 7f0816ffd640 1 -- 172.21.15.17:0/1336141385 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(14..14 src has 1..14) ==== 3471+0+0 (secure 0 0 0) 0x7f08080c95f0 con 0x7f082006d3b0 2024-04-17T02:22:16.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.240+0000 7f081e59c640 1 --2- 172.21.15.17:0/1336141385 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f080009f480 0x7f08000a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:16.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.240+0000 7f081e59c640 1 --2- 172.21.15.17:0/1336141385 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f080009f480 0x7f08000a1940 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f08180012e0 tx=0x7f0818009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:16.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.244+0000 7f0816ffd640 1 -- 172.21.15.17:0/1336141385 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f08080989b0 con 0x7f082006d3b0 2024-04-17T02:22:16.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:16.425+0000 7f0824c8f640 1 -- 172.21.15.17:0/1336141385 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) -- 0x7f0820072710 con 0x7f082006d3b0 2024-04-17T02:22:17.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.119+0000 7f0816ffd640 1 -- 172.21.15.17:0/1336141385 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v15) ==== 173+0+0 (secure 0 0 0) 0x7f08080982b0 con 0x7f082006d3b0 2024-04-17T02:22:17.121 INFO:teuthology.orchestra.run.smithi017.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-17T02:22:17.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.124+0000 7f0824c8f640 10 mgrc shutdown 2024-04-17T02:22:17.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.124+0000 7f0824c8f640 1 -- 172.21.15.17:0/1336141385 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f080009f480 msgr2=0x7f08000a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:17.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.124+0000 7f0824c8f640 1 --2- 172.21.15.17:0/1336141385 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f080009f480 0x7f08000a1940 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f08180012e0 tx=0x7f0818009040 comp rx=0 tx=0).stop 2024-04-17T02:22:17.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.124+0000 7f0824c8f640 1 -- 172.21.15.17:0/1336141385 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f082006d3b0 msgr2=0x7f08200a3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:17.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.124+0000 7f0824c8f640 1 --2- 172.21.15.17:0/1336141385 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f082006d3b0 0x7f08200a3970 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f080800d5f0 tx=0x7f080800dab0 comp rx=0 tx=0).stop 2024-04-17T02:22:17.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.124+0000 7f0824c8f640 1 -- 172.21.15.17:0/1336141385 shutdown_connections 2024-04-17T02:22:17.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.124+0000 7f0824c8f640 1 --2- 172.21.15.17:0/1336141385 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f080009f480 0x7f08000a1940 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:17.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.124+0000 7f0824c8f640 1 --2- 172.21.15.17:0/1336141385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0820072930 0x7f08201406f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:17.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.124+0000 7f0824c8f640 1 --2- 172.21.15.17:0/1336141385 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f082006d3b0 0x7f08200a3970 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:17.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.124+0000 7f0824c8f640 1 --2- 172.21.15.17:0/1336141385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f082006cfd0 0x7f08201425e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:17.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.124+0000 7f0824c8f640 1 -- 172.21.15.17:0/1336141385 >> 172.21.15.17:0/1336141385 conn(0x7f08200a7970 msgr2=0x7f082013d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:17.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.124+0000 7f0824c8f640 1 -- 172.21.15.17:0/1336141385 shutdown_connections 2024-04-17T02:22:17.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.124+0000 7f0824c8f640 1 -- 172.21.15.17:0/1336141385 wait complete. 2024-04-17T02:22:17.138 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-17T02:22:17.138 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-17T02:22:17.138 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-17T02:22:17.141 INFO:tasks.ceph.mds.a:Started 2024-04-17T02:22:17.141 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-17T02:22:17.141 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-17T02:22:17.143 INFO:tasks.ceph.mds.c:Started 2024-04-17T02:22:17.143 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-17T02:22:17.143 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-17T02:22:17.146 INFO:tasks.ceph.mds.b:Started 2024-04-17T02:22:17.147 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-17T02:22:17.147 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T02:22:17.226 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2024-04-17T02:22:17.226 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2024-04-17T02:22:17.226 INFO:tasks.ceph.mds.c.smithi017.stderr:2024-04-17T02:22:17.225+0000 7f1f8e56c640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6810/0: (98) Address already in use 2024-04-17T02:22:17.234 INFO:tasks.ceph.mds.b.smithi122.stdout:starting mds.b at 2024-04-17T02:22:17.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.263+0000 7fa3158e6640 1 Processor -- start 2024-04-17T02:22:17.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.263+0000 7fa3158e6640 1 -- start start 2024-04-17T02:22:17.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.263+0000 7fa3158e6640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa3100ab160 0x7fa3100ab540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:17.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.263+0000 7fa3158e6640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa3100ac5e0 0x7fa3100ac9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:17.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.263+0000 7fa3158e6640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa310146060 con 0x7fa3100a43d0 2024-04-17T02:22:17.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.263+0000 7fa3158e6640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fa3100acff0 con 0x7fa3100ac5e0 2024-04-17T02:22:17.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.263+0000 7fa3158e6640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fa3100a9820 con 0x7fa3100ab160 2024-04-17T02:22:17.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.263+0000 7fa30f7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa3100ac5e0 0x7fa3100ac9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:17.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.263+0000 7fa30f7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa3100ac5e0 0x7fa3100ac9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51400/0 (socket says 172.21.15.17:51400) 2024-04-17T02:22:17.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.263+0000 7fa30f7fe640 1 -- 172.21.15.17:0/2550540089 learned_addr learned my addr 172.21.15.17:0/2550540089 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:17.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.264+0000 7fa30effd640 1 --2- 172.21.15.17:0/2550540089 >> v2:172.21.15.122:3300/0 conn(0x7fa3100ab160 0x7fa3100ab540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:17.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.264+0000 7fa30f7fe640 1 -- 172.21.15.17:0/2550540089 >> v2:172.21.15.122:3300/0 conn(0x7fa3100ab160 msgr2=0x7fa3100ab540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:17.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.264+0000 7fa30f7fe640 1 --2- 172.21.15.17:0/2550540089 >> v2:172.21.15.122:3300/0 conn(0x7fa3100ab160 0x7fa3100ab540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:17.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.264+0000 7fa30f7fe640 1 -- 172.21.15.17:0/2550540089 >> v1:172.21.15.122:6789/0 conn(0x7fa3100a43d0 legacy=0x7fa310145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:17.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.264+0000 7fa30f7fe640 1 -- 172.21.15.17:0/2550540089 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa310145270 con 0x7fa3100ac5e0 2024-04-17T02:22:17.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.264+0000 7fa30effd640 1 --2- 172.21.15.17:0/2550540089 >> v2:172.21.15.122:3300/0 conn(0x7fa3100ab160 0x7fa3100ab540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T02:22:17.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.265+0000 7fa30f7fe640 1 --2- 172.21.15.17:0/2550540089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3100ac5e0 0x7fa3100ac9f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa310068be0 tx=0x7fa30802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a7a296f2a90316 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:17.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.265+0000 7fa30dffb640 1 -- 172.21.15.17:0/2550540089 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa30802c9f0 con 0x7fa3100ac5e0 2024-04-17T02:22:17.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.265+0000 7fa30dffb640 1 -- 172.21.15.17:0/2550540089 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa30802cb90 con 0x7fa3100ac5e0 2024-04-17T02:22:17.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.265+0000 7fa30dffb640 1 -- 172.21.15.17:0/2550540089 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3080343f0 con 0x7fa3100ac5e0 2024-04-17T02:22:17.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.265+0000 7fa3158e6640 1 -- 172.21.15.17:0/2550540089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3100ac5e0 msgr2=0x7fa3100ac9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:17.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.265+0000 7fa3158e6640 1 --2- 172.21.15.17:0/2550540089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3100ac5e0 0x7fa3100ac9f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa310068be0 tx=0x7fa30802be50 comp rx=0 tx=0).stop 2024-04-17T02:22:17.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.265+0000 7fa3158e6640 1 -- 172.21.15.17:0/2550540089 shutdown_connections 2024-04-17T02:22:17.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.265+0000 7fa3158e6640 1 --2- 172.21.15.17:0/2550540089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3100ac5e0 0x7fa3100ac9f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:17.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.265+0000 7fa3158e6640 1 --2- 172.21.15.17:0/2550540089 >> v2:172.21.15.122:3300/0 conn(0x7fa3100ab160 0x7fa3100ab540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:17.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.265+0000 7fa3158e6640 1 -- 172.21.15.17:0/2550540089 >> 172.21.15.17:0/2550540089 conn(0x7fa3100ba940 msgr2=0x7fa3100bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:17.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.265+0000 7fa3158e6640 1 -- 172.21.15.17:0/2550540089 shutdown_connections 2024-04-17T02:22:17.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.265+0000 7fa3158e6640 1 -- 172.21.15.17:0/2550540089 wait complete. 2024-04-17T02:22:17.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.266+0000 7fa3158e6640 1 Processor -- start 2024-04-17T02:22:17.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.266+0000 7fa3158e6640 1 -- start start 2024-04-17T02:22:17.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.267+0000 7fa3158e6640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fa3100a43d0 0x7fa31014de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:17.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.267+0000 7fa3158e6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3100ab160 0x7fa310148bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:17.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.267+0000 7fa3158e6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3100ac5e0 0x7fa310149730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:17.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.267+0000 7fa3158e6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa31014f990 con 0x7fa3100ab160 2024-04-17T02:22:17.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.267+0000 7fa3158e6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa3100a72d0 con 0x7fa3100ac5e0 2024-04-17T02:22:17.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.267+0000 7fa3158e6640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fa31014fb10 con 0x7fa3100a43d0 2024-04-17T02:22:17.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.267+0000 7fa30e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3100ab160 0x7fa310148bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:17.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.267+0000 7fa30e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3100ab160 0x7fa310148bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51402/0 (socket says 172.21.15.17:51402) 2024-04-17T02:22:17.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.267+0000 7fa30e7fc640 1 -- 172.21.15.17:0/400638394 learned_addr learned my addr 172.21.15.17:0/400638394 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:17.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.267+0000 7fa30effd640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fa3100a43d0 0x7fa31014de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:17.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.267+0000 7fa30f7fe640 1 --2- 172.21.15.17:0/400638394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3100ac5e0 0x7fa310149730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:17.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.267+0000 7fa30e7fc640 1 -- 172.21.15.17:0/400638394 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fa3100a43d0 msgr2=0x7fa31014de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:17.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.267+0000 7fa30e7fc640 1 --2- 172.21.15.17:0/400638394 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fa3100a43d0 0x7fa31014de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:17.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.267+0000 7fa30e7fc640 1 -- 172.21.15.17:0/400638394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3100ac5e0 msgr2=0x7fa310149730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:17.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.267+0000 7fa30e7fc640 1 --2- 172.21.15.17:0/400638394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3100ac5e0 0x7fa310149730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:17.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.268+0000 7fa30e7fc640 1 -- 172.21.15.17:0/400638394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa31014e510 con 0x7fa3100ab160 2024-04-17T02:22:17.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.268+0000 7fa30e7fc640 1 --2- 172.21.15.17:0/400638394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3100ab160 0x7fa310148bb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa30400c460 tx=0x7fa30400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:17.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.268+0000 7fa2f7fff640 1 -- 172.21.15.17:0/400638394 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa304016020 con 0x7fa3100ab160 2024-04-17T02:22:17.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.268+0000 7fa2f7fff640 1 -- 172.21.15.17:0/400638394 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa304012870 con 0x7fa3100ab160 2024-04-17T02:22:17.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.268+0000 7fa3158e6640 1 -- 172.21.15.17:0/400638394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa31014e7d0 con 0x7fa3100ab160 2024-04-17T02:22:17.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.268+0000 7fa2f7fff640 1 -- 172.21.15.17:0/400638394 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa304012c60 con 0x7fa3100ab160 2024-04-17T02:22:17.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.268+0000 7fa3158e6640 1 -- 172.21.15.17:0/400638394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa31014d6a0 con 0x7fa3100ab160 2024-04-17T02:22:17.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.269+0000 7fa3158e6640 1 -- 172.21.15.17:0/400638394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa310067020 con 0x7fa3100ab160 2024-04-17T02:22:17.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.270+0000 7fa2f7fff640 1 -- 172.21.15.17:0/400638394 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7fa304019020 con 0x7fa3100ab160 2024-04-17T02:22:17.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.270+0000 7fa2f7fff640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:17.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.270+0000 7fa2f7fff640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:17.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.270+0000 7fa2f7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:17.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.270+0000 7fa2f7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:17.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.270+0000 7fa2f7fff640 1 --2- 172.21.15.17:0/400638394 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fa2fc09f480 0x7fa2fc0a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:17.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.271+0000 7fa30effd640 1 --2- 172.21.15.17:0/400638394 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fa2fc09f480 0x7fa2fc0a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:17.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.271+0000 7fa2f7fff640 1 -- 172.21.15.17:0/400638394 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7fa3040c8af0 con 0x7fa3100ab160 2024-04-17T02:22:17.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.271+0000 7fa30effd640 1 --2- 172.21.15.17:0/400638394 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fa2fc09f480 0x7fa2fc0a1940 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa30000ab60 tx=0x7fa300008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:17.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.275+0000 7fa2f7fff640 1 -- 172.21.15.17:0/400638394 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fa310067020 con 0x7fa3100ab160 2024-04-17T02:22:17.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.457+0000 7fa3158e6640 1 -- 172.21.15.17:0/400638394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa310067f80 con 0x7fa3100ab160 2024-04-17T02:22:17.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.458+0000 7fa2f7fff640 1 -- 172.21.15.17:0/400638394 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+9743 (secure 0 0 0) 0x7fa304020070 con 0x7fa3100ab160 2024-04-17T02:22:17.459 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:22:17.459 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":15,"fsid":"7cbfae20-b10d-41da-92b7-cbd5c1632e23","created":"2024-04-17T02:22:00.246446+0000","modified":"2024-04-17T02:22:17.113045+0000","last_up_change":"2024-04-17T02:22:09.077928+0000","last_in_change":"2024-04-17T02:22:01.415384+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T02:22:10.533377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-17T02:22:15.947495+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2973665c-6c5e-4688-bffe-72d3bdcf467f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6801","nonce":1828284343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6803","nonce":1828284343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6807","nonce":1828284343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6805","nonce":1828284343}]},"public_addr":"172.21.15.17:6801/1828284343","cluster_addr":"172.21.15.17:6803/1828284343","heartbeat_back_addr":"172.21.15.17:6807/1828284343","heartbeat_front_addr":"172.21.15.17:6805/1828284343","state":["exists","up"]},{"osd":1,"uuid":"a59a034d-19b4-47e8-8ca5-538597b4af1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6809","nonce":2064593011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6811","nonce":2064593011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6815","nonce":2064593011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6813","nonce":2064593011}]},"public_addr":"172.21.15.122:6809/2064593011","cluster_addr":"172.21.15.122:6811/2064593011","heartbeat_back_addr":"172.21.15.122:6815/2064593011","heartbeat_front_addr":"172.21.15.122:6813/2064593011","state":["exists","up"]},{"osd":2,"uuid":"070f4c5f-459f-46ff-b980-05b1ac50c951","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6817","nonce":929092547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6819","nonce":929092547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6823","nonce":929092547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6821","nonce":929092547}]},"public_addr":"172.21.15.122:6817/929092547","cluster_addr":"172.21.15.122:6819/929092547","heartbeat_back_addr":"172.21.15.122:6823/929092547","heartbeat_front_addr":"172.21.15.122:6821/929092547","state":["exists","up"]},{"osd":3,"uuid":"96216a49-a7b6-40eb-bc93-cc8c78a5270a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6801","nonce":204132523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6803","nonce":204132523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6807","nonce":204132523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6805","nonce":204132523}]},"public_addr":"172.21.15.122:6801/204132523","cluster_addr":"172.21.15.122:6803/204132523","heartbeat_back_addr":"172.21.15.122:6807/204132523","heartbeat_front_addr":"172.21.15.122:6805/204132523","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.477173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.522791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.590625+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.480698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T02:22:17.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.460+0000 7fa3158e6640 10 mgrc shutdown 2024-04-17T02:22:17.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.460+0000 7fa3158e6640 1 -- 172.21.15.17:0/400638394 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fa2fc09f480 msgr2=0x7fa2fc0a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:17.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.460+0000 7fa3158e6640 1 --2- 172.21.15.17:0/400638394 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fa2fc09f480 0x7fa2fc0a1940 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa30000ab60 tx=0x7fa300008040 comp rx=0 tx=0).stop 2024-04-17T02:22:17.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.460+0000 7fa3158e6640 1 -- 172.21.15.17:0/400638394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3100ab160 msgr2=0x7fa310148bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:17.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.460+0000 7fa3158e6640 1 --2- 172.21.15.17:0/400638394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3100ab160 0x7fa310148bb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa30400c460 tx=0x7fa30400c920 comp rx=0 tx=0).stop 2024-04-17T02:22:17.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.460+0000 7fa3158e6640 1 -- 172.21.15.17:0/400638394 shutdown_connections 2024-04-17T02:22:17.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.460+0000 7fa3158e6640 1 --2- 172.21.15.17:0/400638394 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fa2fc09f480 0x7fa2fc0a1940 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:17.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.460+0000 7fa3158e6640 1 --2- 172.21.15.17:0/400638394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3100ab160 0x7fa310148bb0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:17.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.460+0000 7fa3158e6640 1 --2- 172.21.15.17:0/400638394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3100ac5e0 0x7fa310149730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:17.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.460+0000 7fa3158e6640 1 --2- 172.21.15.17:0/400638394 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fa3100a43d0 0x7fa31014de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:17.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.460+0000 7fa3158e6640 1 -- 172.21.15.17:0/400638394 >> 172.21.15.17:0/400638394 conn(0x7fa3100ba940 msgr2=0x7fa3100a8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:17.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.461+0000 7fa3158e6640 1 -- 172.21.15.17:0/400638394 shutdown_connections 2024-04-17T02:22:17.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.461+0000 7fa3158e6640 1 -- 172.21.15.17:0/400638394 wait complete. 2024-04-17T02:22:17.473 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T02:22:10.533377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-17T02:22:15.947495+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-17T02:22:17.474 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T02:22:17.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.580+0000 7fb29b7a8640 1 Processor -- start 2024-04-17T02:22:17.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.580+0000 7fb29b7a8640 1 -- start start 2024-04-17T02:22:17.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.580+0000 7fb29b7a8640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb2940a9310 0x7fb2940a4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:17.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.580+0000 7fb29b7a8640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb294145160 0x7fb2941455c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:17.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.580+0000 7fb29b7a8640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb2940ac5b0 0x7fb2940aca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:17.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.580+0000 7fb29b7a8640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fb294145c30 con 0x7fb2940ac5b0 2024-04-17T02:22:17.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.580+0000 7fb29b7a8640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fb294145ef0 con 0x7fb2940a9310 2024-04-17T02:22:17.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.580+0000 7fb29b7a8640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fb2940acf80 con 0x7fb294145160 2024-04-17T02:22:17.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.580+0000 7fb299d45640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb2940ac5b0 0x7fb2940aca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:17.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.580+0000 7fb298d43640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb294145160 0x7fb2941455c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:17.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.580+0000 7fb299d45640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb2940ac5b0 0x7fb2940aca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51406/0 (socket says 172.21.15.17:51406) 2024-04-17T02:22:17.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.580+0000 7fb298d43640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb294145160 0x7fb2941455c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:35158/0 (socket says 172.21.15.17:35158) 2024-04-17T02:22:17.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.580+0000 7fb299d45640 1 -- 172.21.15.17:0/311770546 learned_addr learned my addr 172.21.15.17:0/311770546 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:17.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.581+0000 7fb299544640 1 --2- 172.21.15.17:0/311770546 >> v2:172.21.15.122:3300/0 conn(0x7fb2940a9310 0x7fb2940a4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:17.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.581+0000 7fb298d43640 1 -- 172.21.15.17:0/311770546 >> v2:172.21.15.122:3300/0 conn(0x7fb2940a9310 msgr2=0x7fb2940a4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:17.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.581+0000 7fb298d43640 1 --2- 172.21.15.17:0/311770546 >> v2:172.21.15.122:3300/0 conn(0x7fb2940a9310 0x7fb2940a4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:17.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.581+0000 7fb298d43640 1 -- 172.21.15.17:0/311770546 >> v2:172.21.15.17:3300/0 conn(0x7fb2940ac5b0 msgr2=0x7fb2940aca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:17.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.581+0000 7fb298d43640 1 --2- 172.21.15.17:0/311770546 >> v2:172.21.15.17:3300/0 conn(0x7fb2940ac5b0 0x7fb2940aca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:17.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.581+0000 7fb298d43640 1 -- 172.21.15.17:0/311770546 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2940ab850 con 0x7fb294145160 2024-04-17T02:22:17.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.581+0000 7fb299d45640 1 --2- 172.21.15.17:0/311770546 >> v2:172.21.15.17:3300/0 conn(0x7fb2940ac5b0 0x7fb2940aca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:17.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.582+0000 7fb298d43640 1 --2- 172.21.15.17:0/311770546 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb294145160 0x7fb2941455c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb2940aabb0 tx=0x7fb28402b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db7d40c58a5d3b38 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:17.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.582+0000 7fb28bfff640 1 -- 172.21.15.17:0/311770546 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb284038070 con 0x7fb294145160 2024-04-17T02:22:17.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.582+0000 7fb28bfff640 1 -- 172.21.15.17:0/311770546 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb284031700 con 0x7fb294145160 2024-04-17T02:22:17.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.582+0000 7fb28bfff640 1 -- 172.21.15.17:0/311770546 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb284031ad0 con 0x7fb294145160 2024-04-17T02:22:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.582+0000 7fb29b7a8640 1 -- 172.21.15.17:0/311770546 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb294145160 msgr2=0x7fb2941455c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.582+0000 7fb29b7a8640 1 --2- 172.21.15.17:0/311770546 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb294145160 0x7fb2941455c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb2940aabb0 tx=0x7fb28402b7a0 comp rx=0 tx=0).stop 2024-04-17T02:22:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.582+0000 7fb29b7a8640 1 -- 172.21.15.17:0/311770546 shutdown_connections 2024-04-17T02:22:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.582+0000 7fb29b7a8640 1 --2- 172.21.15.17:0/311770546 >> v2:172.21.15.17:3300/0 conn(0x7fb2940ac5b0 0x7fb2940aca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.582+0000 7fb29b7a8640 1 --2- 172.21.15.17:0/311770546 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb294145160 0x7fb2941455c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.582+0000 7fb29b7a8640 1 --2- 172.21.15.17:0/311770546 >> v2:172.21.15.122:3300/0 conn(0x7fb2940a9310 0x7fb2940a4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.582+0000 7fb29b7a8640 1 -- 172.21.15.17:0/311770546 >> 172.21.15.17:0/311770546 conn(0x7fb2940ba940 msgr2=0x7fb2940bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.582+0000 7fb29b7a8640 1 -- 172.21.15.17:0/311770546 shutdown_connections 2024-04-17T02:22:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.582+0000 7fb29b7a8640 1 -- 172.21.15.17:0/311770546 wait complete. 2024-04-17T02:22:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.583+0000 7fb29b7a8640 1 Processor -- start 2024-04-17T02:22:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.583+0000 7fb29b7a8640 1 -- start start 2024-04-17T02:22:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.584+0000 7fb29b7a8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2940ac5b0 0x7fb29409efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:17.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.584+0000 7fb29b7a8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb294145160 0x7fb29409d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:17.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.584+0000 7fb29b7a8640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb294144ae0 0x7fb294099d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:17.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.584+0000 7fb29b7a8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb294148a60 con 0x7fb2940ac5b0 2024-04-17T02:22:17.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.584+0000 7fb29b7a8640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb2941488e0 con 0x7fb294145160 2024-04-17T02:22:17.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.584+0000 7fb29b7a8640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fb294148be0 con 0x7fb294144ae0 2024-04-17T02:22:17.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.584+0000 7fb299544640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2940ac5b0 0x7fb29409efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:17.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.584+0000 7fb299d45640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb294144ae0 0x7fb294099d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:17.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.584+0000 7fb299544640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2940ac5b0 0x7fb29409efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51420/0 (socket says 172.21.15.17:51420) 2024-04-17T02:22:17.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.584+0000 7fb299544640 1 -- 172.21.15.17:0/3659308896 learned_addr learned my addr 172.21.15.17:0/3659308896 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:17.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.584+0000 7fb298d43640 1 --2- 172.21.15.17:0/3659308896 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb294145160 0x7fb29409d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:17.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.584+0000 7fb299544640 1 -- 172.21.15.17:0/3659308896 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb294144ae0 msgr2=0x7fb294099d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:17.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.584+0000 7fb299544640 1 --2- 172.21.15.17:0/3659308896 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb294144ae0 0x7fb294099d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:17.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.584+0000 7fb299544640 1 -- 172.21.15.17:0/3659308896 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb294145160 msgr2=0x7fb29409d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:17.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.584+0000 7fb299544640 1 --2- 172.21.15.17:0/3659308896 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb294145160 0x7fb29409d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:17.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.584+0000 7fb299544640 1 -- 172.21.15.17:0/3659308896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb29409a990 con 0x7fb2940ac5b0 2024-04-17T02:22:17.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.584+0000 7fb299d45640 1 --2- 172.21.15.17:0/3659308896 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb294144ae0 0x7fb294099d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:17.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.584+0000 7fb299544640 1 --2- 172.21.15.17:0/3659308896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2940ac5b0 0x7fb29409efa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb29000e890 tx=0x7fb29000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:17.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.585+0000 7fb289ffb640 1 -- 172.21.15.17:0/3659308896 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb290017070 con 0x7fb2940ac5b0 2024-04-17T02:22:17.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.585+0000 7fb289ffb640 1 -- 172.21.15.17:0/3659308896 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb29000c940 con 0x7fb2940ac5b0 2024-04-17T02:22:17.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.585+0000 7fb29b7a8640 1 -- 172.21.15.17:0/3659308896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb29409ac50 con 0x7fb2940ac5b0 2024-04-17T02:22:17.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.585+0000 7fb289ffb640 1 -- 172.21.15.17:0/3659308896 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29000cd10 con 0x7fb2940ac5b0 2024-04-17T02:22:17.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.585+0000 7fb29b7a8640 1 -- 172.21.15.17:0/3659308896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb29409e530 con 0x7fb2940ac5b0 2024-04-17T02:22:17.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.586+0000 7fb29b7a8640 1 -- 172.21.15.17:0/3659308896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2940687f0 con 0x7fb2940ac5b0 2024-04-17T02:22:17.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.587+0000 7fb289ffb640 1 -- 172.21.15.17:0/3659308896 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7fb29001a070 con 0x7fb2940ac5b0 2024-04-17T02:22:17.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.587+0000 7fb289ffb640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:17.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.587+0000 7fb289ffb640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:17.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.587+0000 7fb289ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:17.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.587+0000 7fb289ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:17.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.587+0000 7fb289ffb640 1 --2- 172.21.15.17:0/3659308896 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fb27809f480 0x7fb2780a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:17.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.588+0000 7fb298d43640 1 --2- 172.21.15.17:0/3659308896 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fb27809f480 0x7fb2780a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:17.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.588+0000 7fb289ffb640 1 -- 172.21.15.17:0/3659308896 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7fb2900c9430 con 0x7fb2940ac5b0 2024-04-17T02:22:17.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.588+0000 7fb298d43640 1 --2- 172.21.15.17:0/3659308896 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fb27809f480 0x7fb2780a1940 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb284035000 tx=0x7fb284008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:17.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.592+0000 7fb289ffb640 1 -- 172.21.15.17:0/3659308896 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb2900980f0 con 0x7fb2940ac5b0 2024-04-17T02:22:17.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.770+0000 7fb29b7a8640 1 -- 172.21.15.17:0/3659308896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb29406c250 con 0x7fb2940ac5b0 2024-04-17T02:22:17.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.770+0000 7fb289ffb640 1 -- 172.21.15.17:0/3659308896 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v15) ==== 93+0+10 (secure 0 0 0) 0x7fb29009c190 con 0x7fb2940ac5b0 2024-04-17T02:22:17.772 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-04-17T02:22:17.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.772+0000 7fb29b7a8640 10 mgrc shutdown 2024-04-17T02:22:17.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.772+0000 7fb29b7a8640 1 -- 172.21.15.17:0/3659308896 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fb27809f480 msgr2=0x7fb2780a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:17.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.772+0000 7fb29b7a8640 1 --2- 172.21.15.17:0/3659308896 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fb27809f480 0x7fb2780a1940 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb284035000 tx=0x7fb284008030 comp rx=0 tx=0).stop 2024-04-17T02:22:17.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.772+0000 7fb29b7a8640 1 -- 172.21.15.17:0/3659308896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2940ac5b0 msgr2=0x7fb29409efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:17.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.772+0000 7fb29b7a8640 1 --2- 172.21.15.17:0/3659308896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2940ac5b0 0x7fb29409efa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb29000e890 tx=0x7fb29000ed50 comp rx=0 tx=0).stop 2024-04-17T02:22:17.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.772+0000 7fb29b7a8640 1 -- 172.21.15.17:0/3659308896 shutdown_connections 2024-04-17T02:22:17.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.772+0000 7fb29b7a8640 1 --2- 172.21.15.17:0/3659308896 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fb27809f480 0x7fb2780a1940 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:17.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.772+0000 7fb29b7a8640 1 --2- 172.21.15.17:0/3659308896 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb294144ae0 0x7fb294099d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:17.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.772+0000 7fb29b7a8640 1 --2- 172.21.15.17:0/3659308896 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb294145160 0x7fb29409d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:17.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.772+0000 7fb29b7a8640 1 --2- 172.21.15.17:0/3659308896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2940ac5b0 0x7fb29409efa0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:17.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.772+0000 7fb29b7a8640 1 -- 172.21.15.17:0/3659308896 >> 172.21.15.17:0/3659308896 conn(0x7fb2940ba940 msgr2=0x7fb294146c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:17.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.772+0000 7fb29b7a8640 1 -- 172.21.15.17:0/3659308896 shutdown_connections 2024-04-17T02:22:17.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.773+0000 7fb29b7a8640 1 -- 172.21.15.17:0/3659308896 wait complete. 2024-04-17T02:22:17.784 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-17T02:22:17.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.889+0000 7f8774588640 1 Processor -- start 2024-04-17T02:22:17.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.889+0000 7f8774588640 1 -- start start 2024-04-17T02:22:17.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.890+0000 7f8774588640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f876c0a9c00 0x7f876c0aa090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:17.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.890+0000 7f8774588640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f876c148870 con 0x7f876c0b8e30 2024-04-17T02:22:17.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.890+0000 7f8774588640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f876c13bc90 con 0x7f876c13b540 2024-04-17T02:22:17.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.890+0000 7f8774588640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f876c0b9210 con 0x7f876c0a9c00 2024-04-17T02:22:17.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.890+0000 7f8772b25640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f876c0a9c00 0x7f876c0aa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:17.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.890+0000 7f8772b25640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f876c0a9c00 0x7f876c0aa090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51436/0 (socket says 172.21.15.17:51436) 2024-04-17T02:22:17.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.890+0000 7f8772324640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f876c0b8e30 0x7f876c0aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53822/0 (socket says 172.21.15.17:53822) 2024-04-17T02:22:17.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.890+0000 7f8772b25640 1 -- 172.21.15.17:0/332907967 learned_addr learned my addr 172.21.15.17:0/332907967 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:17.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.891+0000 7f8772b25640 1 -- 172.21.15.17:0/332907967 >> v1:172.21.15.122:6789/0 conn(0x7f876c13b540 legacy=0x7f876c148f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:17.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.891+0000 7f8772b25640 1 -- 172.21.15.17:0/332907967 >> v1:172.21.15.17:6789/0 conn(0x7f876c0b8e30 legacy=0x7f876c0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:17.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.891+0000 7f8771322640 1 -- 172.21.15.17:0/332907967 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4062217308 0 0) 0x7f876c148870 con 0x7f876c0b8e30 2024-04-17T02:22:17.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.891+0000 7f8772b25640 1 -- 172.21.15.17:0/332907967 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f876c152a50 con 0x7f876c0a9c00 2024-04-17T02:22:17.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.891+0000 7f8772b25640 1 --2- 172.21.15.17:0/332907967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f876c0a9c00 0x7f876c0aa090 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8764009e50 tx=0x7f876402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3628201e3009e0e server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:17.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.891+0000 7f8771322640 1 -- 172.21.15.17:0/332907967 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f876402cb20 con 0x7f876c0a9c00 2024-04-17T02:22:17.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.891+0000 7f8771322640 1 -- 172.21.15.17:0/332907967 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f876402ccc0 con 0x7f876c0a9c00 2024-04-17T02:22:17.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.892+0000 7f8771322640 1 -- 172.21.15.17:0/332907967 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8764034610 con 0x7f876c0a9c00 2024-04-17T02:22:17.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.892+0000 7f8774588640 1 -- 172.21.15.17:0/332907967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f876c0a9c00 msgr2=0x7f876c0aa090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:17.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.892+0000 7f8774588640 1 --2- 172.21.15.17:0/332907967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f876c0a9c00 0x7f876c0aa090 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8764009e50 tx=0x7f876402bf80 comp rx=0 tx=0).stop 2024-04-17T02:22:17.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.892+0000 7f8774588640 1 -- 172.21.15.17:0/332907967 shutdown_connections 2024-04-17T02:22:17.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.892+0000 7f8774588640 1 --2- 172.21.15.17:0/332907967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f876c0a9c00 0x7f876c0aa090 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:17.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.892+0000 7f8774588640 1 -- 172.21.15.17:0/332907967 >> 172.21.15.17:0/332907967 conn(0x7f876c0741a0 msgr2=0x7f876c0745b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:17.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.892+0000 7f8774588640 1 -- 172.21.15.17:0/332907967 shutdown_connections 2024-04-17T02:22:17.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.892+0000 7f8774588640 1 -- 172.21.15.17:0/332907967 wait complete. 2024-04-17T02:22:17.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.893+0000 7f8774588640 1 Processor -- start 2024-04-17T02:22:17.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.893+0000 7f8774588640 1 -- start start 2024-04-17T02:22:17.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.894+0000 7f8774588640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f876c0a9c00 0x7f876c0a2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:17.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.894+0000 7f8774588640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f876c0b8e30 0x7f876c0a4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:17.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.894+0000 7f8774588640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f876c13b540 0x7f876c0a23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:17.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.894+0000 7f8774588640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f876c150c40 con 0x7f876c0b8e30 2024-04-17T02:22:17.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.894+0000 7f8774588640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f876c149660 con 0x7f876c13b540 2024-04-17T02:22:17.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.894+0000 7f8774588640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f876c150dc0 con 0x7f876c0a9c00 2024-04-17T02:22:17.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.894+0000 7f8772324640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f876c0a9c00 0x7f876c0a2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:17.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.894+0000 7f8771b23640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f876c0b8e30 0x7f876c0a4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:17.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.894+0000 7f8772324640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f876c0a9c00 0x7f876c0a2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:35176/0 (socket says 172.21.15.17:35176) 2024-04-17T02:22:17.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.894+0000 7f8772324640 1 -- 172.21.15.17:0/4006948057 learned_addr learned my addr 172.21.15.17:0/4006948057 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:17.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.894+0000 7f8771b23640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f876c0b8e30 0x7f876c0a4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51442/0 (socket says 172.21.15.17:51442) 2024-04-17T02:22:17.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.894+0000 7f8772b25640 1 --2- 172.21.15.17:0/4006948057 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f876c13b540 0x7f876c0a23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:17.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.894+0000 7f8772324640 1 -- 172.21.15.17:0/4006948057 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f876c13b540 msgr2=0x7f876c0a23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:17.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.894+0000 7f8772324640 1 --2- 172.21.15.17:0/4006948057 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f876c13b540 0x7f876c0a23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:17.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.894+0000 7f8772324640 1 -- 172.21.15.17:0/4006948057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f876c0b8e30 msgr2=0x7f876c0a4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:17.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.894+0000 7f8772324640 1 --2- 172.21.15.17:0/4006948057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f876c0b8e30 0x7f876c0a4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:17.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.894+0000 7f8772324640 1 -- 172.21.15.17:0/4006948057 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f876c0a4430 con 0x7f876c0a9c00 2024-04-17T02:22:17.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.894+0000 7f8772324640 1 --2- 172.21.15.17:0/4006948057 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f876c0a9c00 0x7f876c0a2e40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f876800c4a0 tx=0x7f876800c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:17.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.894+0000 7f8762ffd640 1 -- 172.21.15.17:0/4006948057 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8768018070 con 0x7f876c0a9c00 2024-04-17T02:22:17.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.894+0000 7f8762ffd640 1 -- 172.21.15.17:0/4006948057 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87680074e0 con 0x7f876c0a9c00 2024-04-17T02:22:17.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.894+0000 7f8774588640 1 -- 172.21.15.17:0/4006948057 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f876c0a46f0 con 0x7f876c0a9c00 2024-04-17T02:22:17.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.894+0000 7f8762ffd640 1 -- 172.21.15.17:0/4006948057 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8768004a20 con 0x7f876c0a9c00 2024-04-17T02:22:17.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.895+0000 7f8774588640 1 -- 172.21.15.17:0/4006948057 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f876c0a4100 con 0x7f876c0a9c00 2024-04-17T02:22:17.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.895+0000 7f8774588640 1 -- 172.21.15.17:0/4006948057 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f876c06ee70 con 0x7f876c0a9c00 2024-04-17T02:22:17.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.897+0000 7f8762ffd640 1 -- 172.21.15.17:0/4006948057 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f876801b070 con 0x7f876c0a9c00 2024-04-17T02:22:17.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.897+0000 7f8762ffd640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:17.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.897+0000 7f8762ffd640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:17.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.897+0000 7f8762ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:17.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.897+0000 7f8762ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:17.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.897+0000 7f8762ffd640 1 --2- 172.21.15.17:0/4006948057 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f875009f480 0x7f87500a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:17.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.897+0000 7f8771b23640 1 --2- 172.21.15.17:0/4006948057 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f875009f480 0x7f87500a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:17.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.897+0000 7f8762ffd640 1 -- 172.21.15.17:0/4006948057 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7f87680c86d0 con 0x7f876c0a9c00 2024-04-17T02:22:17.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.898+0000 7f8771b23640 1 --2- 172.21.15.17:0/4006948057 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f875009f480 0x7f87500a1940 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f876c13b0d0 tx=0x7f875c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:17.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:17.900+0000 7f8762ffd640 1 -- 172.21.15.17:0/4006948057 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f876c06ee70 con 0x7f876c0a9c00 2024-04-17T02:22:18.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.080+0000 7f8774588640 1 -- 172.21.15.17:0/4006948057 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) -- 0x7f876c0687f0 con 0x7f876c0a9c00 2024-04-17T02:22:18.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.080+0000 7f8762ffd640 1 -- 172.21.15.17:0/4006948057 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v15) ==== 92+0+10 (secure 0 0 0) 0x7f8768097430 con 0x7f876c0a9c00 2024-04-17T02:22:18.081 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2024-04-17T02:22:18.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.082+0000 7f8774588640 10 mgrc shutdown 2024-04-17T02:22:18.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.082+0000 7f8774588640 1 -- 172.21.15.17:0/4006948057 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f875009f480 msgr2=0x7f87500a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:18.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.082+0000 7f8774588640 1 --2- 172.21.15.17:0/4006948057 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f875009f480 0x7f87500a1940 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f876c13b0d0 tx=0x7f875c009040 comp rx=0 tx=0).stop 2024-04-17T02:22:18.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.082+0000 7f8774588640 1 -- 172.21.15.17:0/4006948057 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f876c0a9c00 msgr2=0x7f876c0a2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:18.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.082+0000 7f8774588640 1 --2- 172.21.15.17:0/4006948057 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f876c0a9c00 0x7f876c0a2e40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f876800c4a0 tx=0x7f876800c960 comp rx=0 tx=0).stop 2024-04-17T02:22:18.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.082+0000 7f8774588640 1 -- 172.21.15.17:0/4006948057 shutdown_connections 2024-04-17T02:22:18.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.082+0000 7f8774588640 1 --2- 172.21.15.17:0/4006948057 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f875009f480 0x7f87500a1940 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:18.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.082+0000 7f8774588640 1 --2- 172.21.15.17:0/4006948057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f876c0b8e30 0x7f876c0a4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:18.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.082+0000 7f8774588640 1 --2- 172.21.15.17:0/4006948057 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f876c13b540 0x7f876c0a23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:18.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.082+0000 7f8774588640 1 --2- 172.21.15.17:0/4006948057 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f876c0a9c00 0x7f876c0a2e40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:18.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.082+0000 7f8774588640 1 -- 172.21.15.17:0/4006948057 >> 172.21.15.17:0/4006948057 conn(0x7f876c0741a0 msgr2=0x7f876c068ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:18.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.082+0000 7f8774588640 1 -- 172.21.15.17:0/4006948057 shutdown_connections 2024-04-17T02:22:18.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.082+0000 7f8774588640 1 -- 172.21.15.17:0/4006948057 wait complete. 2024-04-17T02:22:18.094 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T02:22:18.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.199+0000 7f0853693640 1 Processor -- start 2024-04-17T02:22:18.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.199+0000 7f0853693640 1 -- start start 2024-04-17T02:22:18.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.199+0000 7f0853693640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f084c13b540 0x7f084c148f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:18.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.199+0000 7f0853693640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f084c0a9c00 0x7f084c0aa090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:18.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.199+0000 7f0853693640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f084c148870 con 0x7f084c0b8e30 2024-04-17T02:22:18.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.199+0000 7f0853693640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f084c0b9210 con 0x7f084c13b540 2024-04-17T02:22:18.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.199+0000 7f0853693640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f084c13bc90 con 0x7f084c0a9c00 2024-04-17T02:22:18.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.199+0000 7f0850c2e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f084c13b540 0x7f084c148f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:18.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.200+0000 7f0851c30640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f084c0a9c00 0x7f084c0aa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:18.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.200+0000 7f0850c2e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f084c13b540 0x7f084c148f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51458/0 (socket says 172.21.15.17:51458) 2024-04-17T02:22:18.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.200+0000 7f0850c2e640 1 -- 172.21.15.17:0/3098026746 learned_addr learned my addr 172.21.15.17:0/3098026746 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:18.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.200+0000 7f0850c2e640 1 -- 172.21.15.17:0/3098026746 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f084c0a9c00 msgr2=0x7f084c0aa090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:18.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.200+0000 7f0850c2e640 1 --2- 172.21.15.17:0/3098026746 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f084c0a9c00 0x7f084c0aa090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:18.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.200+0000 7f0850c2e640 1 -- 172.21.15.17:0/3098026746 >> v1:172.21.15.122:6789/0 conn(0x7f084c0b8e30 legacy=0x7f084c0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:18.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.200+0000 7f0850c2e640 1 -- 172.21.15.17:0/3098026746 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f084c149490 con 0x7f084c13b540 2024-04-17T02:22:18.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.200+0000 7f0851c30640 1 --2- 172.21.15.17:0/3098026746 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f084c0a9c00 0x7f084c0aa090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:18.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.201+0000 7f0850c2e640 1 --2- 172.21.15.17:0/3098026746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f084c13b540 0x7f084c148f50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f083c009850 tx=0x7f083c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bfaeb1f5cda6a24 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:18.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.201+0000 7f0843fff640 1 -- 172.21.15.17:0/3098026746 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083c004230 con 0x7f084c13b540 2024-04-17T02:22:18.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.201+0000 7f0843fff640 1 -- 172.21.15.17:0/3098026746 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f083c0043d0 con 0x7f084c13b540 2024-04-17T02:22:18.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.201+0000 7f0843fff640 1 -- 172.21.15.17:0/3098026746 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083c031830 con 0x7f084c13b540 2024-04-17T02:22:18.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.201+0000 7f0853693640 1 -- 172.21.15.17:0/3098026746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f084c13b540 msgr2=0x7f084c148f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:18.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.201+0000 7f0853693640 1 --2- 172.21.15.17:0/3098026746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f084c13b540 0x7f084c148f50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f083c009850 tx=0x7f083c02b8d0 comp rx=0 tx=0).stop 2024-04-17T02:22:18.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.201+0000 7f0853693640 1 -- 172.21.15.17:0/3098026746 shutdown_connections 2024-04-17T02:22:18.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.201+0000 7f0853693640 1 --2- 172.21.15.17:0/3098026746 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f084c0a9c00 0x7f084c0aa090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:18.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.201+0000 7f0853693640 1 --2- 172.21.15.17:0/3098026746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f084c13b540 0x7f084c148f50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:18.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.201+0000 7f0853693640 1 -- 172.21.15.17:0/3098026746 >> 172.21.15.17:0/3098026746 conn(0x7f084c0741a0 msgr2=0x7f084c0745b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:18.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.201+0000 7f0853693640 1 -- 172.21.15.17:0/3098026746 shutdown_connections 2024-04-17T02:22:18.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.201+0000 7f0853693640 1 -- 172.21.15.17:0/3098026746 wait complete. 2024-04-17T02:22:18.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.202+0000 7f0853693640 1 Processor -- start 2024-04-17T02:22:18.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.202+0000 7f0853693640 1 -- start start 2024-04-17T02:22:18.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.203+0000 7f0853693640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f084c0a9c00 0x7f084c130210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:18.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.203+0000 7f0853693640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f084c0b8e30 0x7f084c0b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:18.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.203+0000 7f0853693640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f084c13b540 0x7f084c0b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:18.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.203+0000 7f0853693640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f084c14fdb0 con 0x7f084c0a9c00 2024-04-17T02:22:18.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.203+0000 7f0853693640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f084c14fc30 con 0x7f084c0b8e30 2024-04-17T02:22:18.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.203+0000 7f0853693640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f084c14ff30 con 0x7f084c13b540 2024-04-17T02:22:18.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.203+0000 7f085142f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f084c0a9c00 0x7f084c130210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:18.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.203+0000 7f0851c30640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f084c13b540 0x7f084c0b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:18.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.203+0000 7f085142f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f084c0a9c00 0x7f084c130210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51466/0 (socket says 172.21.15.17:51466) 2024-04-17T02:22:18.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.203+0000 7f085142f640 1 -- 172.21.15.17:0/51769700 learned_addr learned my addr 172.21.15.17:0/51769700 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:18.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.203+0000 7f0850c2e640 1 --2- 172.21.15.17:0/51769700 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f084c0b8e30 0x7f084c0b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:18.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.203+0000 7f085142f640 1 -- 172.21.15.17:0/51769700 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f084c13b540 msgr2=0x7f084c0b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:18.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.203+0000 7f085142f640 1 --2- 172.21.15.17:0/51769700 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f084c13b540 0x7f084c0b2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:18.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.203+0000 7f085142f640 1 -- 172.21.15.17:0/51769700 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f084c0b8e30 msgr2=0x7f084c0b5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:18.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.203+0000 7f085142f640 1 --2- 172.21.15.17:0/51769700 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f084c0b8e30 0x7f084c0b5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:18.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.203+0000 7f085142f640 1 -- 172.21.15.17:0/51769700 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f084c1308a0 con 0x7f084c0a9c00 2024-04-17T02:22:18.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.203+0000 7f0851c30640 1 --2- 172.21.15.17:0/51769700 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f084c13b540 0x7f084c0b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:18.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.204+0000 7f085142f640 1 --2- 172.21.15.17:0/51769700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f084c0a9c00 0x7f084c130210 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f084800c430 tx=0x7f084800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:18.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.204+0000 7f0841ffb640 1 -- 172.21.15.17:0/51769700 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08480052d0 con 0x7f084c0a9c00 2024-04-17T02:22:18.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.204+0000 7f0841ffb640 1 -- 172.21.15.17:0/51769700 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0848005490 con 0x7f084c0a9c00 2024-04-17T02:22:18.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.204+0000 7f0853693640 1 -- 172.21.15.17:0/51769700 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f084c130b60 con 0x7f084c0a9c00 2024-04-17T02:22:18.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.204+0000 7f0841ffb640 1 -- 172.21.15.17:0/51769700 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0848007260 con 0x7f084c0a9c00 2024-04-17T02:22:18.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.204+0000 7f0853693640 1 -- 172.21.15.17:0/51769700 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f084c13a5e0 con 0x7f084c0a9c00 2024-04-17T02:22:18.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.205+0000 7f0853693640 1 -- 172.21.15.17:0/51769700 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f084c0b67f0 con 0x7f084c0a9c00 2024-04-17T02:22:18.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.206+0000 7f0841ffb640 1 -- 172.21.15.17:0/51769700 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f0848007400 con 0x7f084c0a9c00 2024-04-17T02:22:18.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.206+0000 7f0841ffb640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:18.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.206+0000 7f0841ffb640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:18.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.206+0000 7f0841ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:18.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.206+0000 7f0841ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:18.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.206+0000 7f0841ffb640 1 --2- 172.21.15.17:0/51769700 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f083009f480 0x7f08300a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:18.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.207+0000 7f0850c2e640 1 --2- 172.21.15.17:0/51769700 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f083009f480 0x7f08300a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:18.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.207+0000 7f0841ffb640 1 -- 172.21.15.17:0/51769700 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7f08480c8700 con 0x7f084c0a9c00 2024-04-17T02:22:18.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.207+0000 7f0850c2e640 1 --2- 172.21.15.17:0/51769700 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f083009f480 0x7f08300a1940 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f083c035000 tx=0x7f083c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:18.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.211+0000 7f0841ffb640 1 -- 172.21.15.17:0/51769700 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f084c0b67f0 con 0x7f084c0a9c00 2024-04-17T02:22:18.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.431+0000 7f0853693640 1 -- 172.21.15.17:0/51769700 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f084c0a50d0 con 0x7f084c0a9c00 2024-04-17T02:22:18.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.432+0000 7f0841ffb640 1 -- 172.21.15.17:0/51769700 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3037 (secure 0 0 0) 0x7f084c0a50d0 con 0x7f084c0a9c00 2024-04-17T02:22:18.433 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:22:18.433 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4228,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6813/1946927344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6811","nonce":1946927344},{"type":"v1","addr":"172.21.15.17:6813","nonce":1946927344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4234,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6825/529920036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":529920036},{"type":"v1","addr":"172.21.15.122:6825","nonce":529920036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6812/356803728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":356803728},{"type":"v1","addr":"172.21.15.17:6812","nonce":356803728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-17T02:22:18.433 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 3 2024-04-17T02:22:18.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.433+0000 7f0853693640 10 mgrc shutdown 2024-04-17T02:22:18.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.433+0000 7f0853693640 1 -- 172.21.15.17:0/51769700 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f083009f480 msgr2=0x7f08300a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:18.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.433+0000 7f0853693640 1 --2- 172.21.15.17:0/51769700 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f083009f480 0x7f08300a1940 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f083c035000 tx=0x7f083c008030 comp rx=0 tx=0).stop 2024-04-17T02:22:18.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.433+0000 7f0853693640 1 -- 172.21.15.17:0/51769700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f084c0a9c00 msgr2=0x7f084c130210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:18.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.433+0000 7f0853693640 1 --2- 172.21.15.17:0/51769700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f084c0a9c00 0x7f084c130210 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f084800c430 tx=0x7f084800c830 comp rx=0 tx=0).stop 2024-04-17T02:22:18.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.433+0000 7f0853693640 1 -- 172.21.15.17:0/51769700 shutdown_connections 2024-04-17T02:22:18.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.433+0000 7f0853693640 1 --2- 172.21.15.17:0/51769700 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f083009f480 0x7f08300a1940 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:18.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.433+0000 7f0853693640 1 --2- 172.21.15.17:0/51769700 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f084c13b540 0x7f084c0b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:18.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.433+0000 7f0853693640 1 --2- 172.21.15.17:0/51769700 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f084c0b8e30 0x7f084c0b5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:18.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.433+0000 7f0853693640 1 --2- 172.21.15.17:0/51769700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f084c0a9c00 0x7f084c130210 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:18.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.433+0000 7f0853693640 1 -- 172.21.15.17:0/51769700 >> 172.21.15.17:0/51769700 conn(0x7f084c0741a0 msgr2=0x7f084c072220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:18.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.434+0000 7f0853693640 1 -- 172.21.15.17:0/51769700 shutdown_connections 2024-04-17T02:22:18.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.434+0000 7f0853693640 1 -- 172.21.15.17:0/51769700 wait complete. 2024-04-17T02:22:18.445 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T02:22:18.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.549+0000 7f1a21ce6640 1 Processor -- start 2024-04-17T02:22:18.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.549+0000 7f1a21ce6640 1 -- start start 2024-04-17T02:22:18.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.550+0000 7f1a21ce6640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1a1c14e960 0x7f1a1c150d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:18.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.550+0000 7f1a21ce6640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a1c0a7f00 con 0x7f1a1c0ab3b0 2024-04-17T02:22:18.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.550+0000 7f1a21ce6640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a1c0abd20 con 0x7f1a1c0a9560 2024-04-17T02:22:18.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.550+0000 7f1a21ce6640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f1a1c0ac000 con 0x7f1a1c14e960 2024-04-17T02:22:18.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.550+0000 7f1a1b7fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f1a1c0ab3b0 0x7f1a1c0ac7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53838/0 (socket says 172.21.15.17:53838) 2024-04-17T02:22:18.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.550+0000 7f1a1b7fe640 1 -- 172.21.15.17:0/2905925134 learned_addr learned my addr 172.21.15.17:0/2905925134 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:22:18.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.550+0000 7f1a1bfff640 1 --2- 172.21.15.17:0/2905925134 >> v2:172.21.15.122:3300/0 conn(0x7f1a1c14e960 0x7f1a1c150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:18.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.550+0000 7f1a1affd640 1 -- 172.21.15.17:0/2905925134 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1542072406 0 0) 0x7f1a1c0a7f00 con 0x7f1a1c0ab3b0 2024-04-17T02:22:18.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.550+0000 7f1a1affd640 1 -- 172.21.15.17:0/2905925134 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a08003520 con 0x7f1a1c0ab3b0 2024-04-17T02:22:18.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.550+0000 7f1a1affd640 1 -- 172.21.15.17:0/2905925134 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 817343096 0 0) 0x7f1a08003520 con 0x7f1a1c0ab3b0 2024-04-17T02:22:18.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.550+0000 7f1a1affd640 1 -- 172.21.15.17:0/2905925134 >> v2:172.21.15.122:3300/0 conn(0x7f1a1c14e960 msgr2=0x7f1a1c150d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:18.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.550+0000 7f1a1affd640 1 --2- 172.21.15.17:0/2905925134 >> v2:172.21.15.122:3300/0 conn(0x7f1a1c14e960 0x7f1a1c150d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:18.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.550+0000 7f1a1affd640 1 -- 172.21.15.17:0/2905925134 >> v1:172.21.15.122:6789/0 conn(0x7f1a1c0a9560 legacy=0x7f1a1c145730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:18.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.550+0000 7f1a1affd640 1 -- 172.21.15.17:0/2905925134 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a1c0a7960 con 0x7f1a1c0ab3b0 2024-04-17T02:22:18.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.550+0000 7f1a1affd640 1 -- 172.21.15.17:0/2905925134 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1752030744 0 0) 0x7f1a0c001670 con 0x7f1a1c0ab3b0 2024-04-17T02:22:18.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.550+0000 7f1a1bfff640 1 --2- 172.21.15.17:0/2905925134 >> v2:172.21.15.122:3300/0 conn(0x7f1a1c14e960 0x7f1a1c150d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:18.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.550+0000 7f1a1affd640 1 -- 172.21.15.17:0/2905925134 >> v1:172.21.15.17:6789/0 conn(0x7f1a1c0ab3b0 legacy=0x7f1a1c0ac7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:18.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.550+0000 7f1a1affd640 1 --2- 172.21.15.17:0/2905925134 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f1a080039b0 0x7f1a08003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:18.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.550+0000 7f1a1affd640 1 --2- 172.21.15.17:0/2905925134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a08004800 0x7f1a08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:18.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.550+0000 7f1a1affd640 1 --2- 172.21.15.17:0/2905925134 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a080051c0 0x7f1a0800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:18.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.550+0000 7f1a1affd640 1 -- 172.21.15.17:0/2905925134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1a1c0ac000 con 0x7f1a08004800 2024-04-17T02:22:18.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.550+0000 7f1a1affd640 1 -- 172.21.15.17:0/2905925134 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0800c160 con 0x7f1a080051c0 2024-04-17T02:22:18.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.550+0000 7f1a1affd640 1 -- 172.21.15.17:0/2905925134 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f1a0800c360 con 0x7f1a080039b0 2024-04-17T02:22:18.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.550+0000 7f1a13fff640 1 --2- 172.21.15.17:0/2905925134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a08004800 0x7f1a08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:18.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.550+0000 7f1a1b7fe640 1 --2- 172.21.15.17:0/2905925134 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f1a080039b0 0x7f1a08003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:18.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.550+0000 7f1a1bfff640 1 --2- 172.21.15.17:0/2905925134 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a080051c0 0x7f1a0800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:18.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.551+0000 7f1a13fff640 1 -- 172.21.15.17:0/2905925134 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f1a080039b0 msgr2=0x7f1a08003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:18.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.551+0000 7f1a13fff640 1 --2- 172.21.15.17:0/2905925134 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f1a080039b0 0x7f1a08003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:18.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.551+0000 7f1a13fff640 1 -- 172.21.15.17:0/2905925134 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a080051c0 msgr2=0x7f1a0800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:18.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.551+0000 7f1a13fff640 1 --2- 172.21.15.17:0/2905925134 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a080051c0 0x7f1a0800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:18.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.551+0000 7f1a13fff640 1 -- 172.21.15.17:0/2905925134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a08003520 con 0x7f1a08004800 2024-04-17T02:22:18.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.551+0000 7f1a1bfff640 1 -- 172.21.15.17:0/2905925134 reap_dead start 2024-04-17T02:22:18.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.551+0000 7f1a13fff640 1 --2- 172.21.15.17:0/2905925134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a08004800 0x7f1a08004c80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1a04001720 tx=0x7f1a08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b11a47a7a7e9d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:18.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.552+0000 7f1a1affd640 1 -- 172.21.15.17:0/2905925134 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a04001370 con 0x7f1a08004800 2024-04-17T02:22:18.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.552+0000 7f1a1affd640 1 -- 172.21.15.17:0/2905925134 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a040052d0 con 0x7f1a08004800 2024-04-17T02:22:18.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.552+0000 7f1a1affd640 1 -- 172.21.15.17:0/2905925134 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a04003830 con 0x7f1a08004800 2024-04-17T02:22:18.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.552+0000 7f1a21ce6640 1 -- 172.21.15.17:0/2905925134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a08004800 msgr2=0x7f1a08004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:18.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.552+0000 7f1a21ce6640 1 --2- 172.21.15.17:0/2905925134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a08004800 0x7f1a08004c80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1a04001720 tx=0x7f1a08005830 comp rx=0 tx=0).stop 2024-04-17T02:22:18.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.552+0000 7f1a21ce6640 1 -- 172.21.15.17:0/2905925134 shutdown_connections 2024-04-17T02:22:18.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.552+0000 7f1a21ce6640 1 --2- 172.21.15.17:0/2905925134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a08004800 0x7f1a08004c80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:18.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.552+0000 7f1a21ce6640 1 -- 172.21.15.17:0/2905925134 >> 172.21.15.17:0/2905925134 conn(0x7f1a1c0a9b60 msgr2=0x7f1a1c0a9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:18.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.552+0000 7f1a21ce6640 1 -- 172.21.15.17:0/2905925134 shutdown_connections 2024-04-17T02:22:18.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.552+0000 7f1a21ce6640 1 -- 172.21.15.17:0/2905925134 wait complete. 2024-04-17T02:22:18.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.553+0000 7f1a21ce6640 1 Processor -- start 2024-04-17T02:22:18.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.553+0000 7f1a21ce6640 1 -- start start 2024-04-17T02:22:18.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.554+0000 7f1a21ce6640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f1a08004800 0x7f1a1c149c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:18.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.554+0000 7f1a21ce6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a1c1496e0 0x7f1a1c1da100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:18.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.554+0000 7f1a21ce6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a1c14b0a0 0x7f1a1c140770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:18.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.554+0000 7f1a21ce6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1a1c06b5b0 con 0x7f1a1c1496e0 2024-04-17T02:22:18.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.554+0000 7f1a21ce6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1a1c0ac7a0 con 0x7f1a1c14b0a0 2024-04-17T02:22:18.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.554+0000 7f1a21ce6640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f1a1c1da7e0 con 0x7f1a08004800 2024-04-17T02:22:18.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.554+0000 7f1a1b7fe640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f1a08004800 0x7f1a1c149c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:18.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.554+0000 7f1a13fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a1c1496e0 0x7f1a1c1da100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:18.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.554+0000 7f1a1b7fe640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f1a08004800 0x7f1a1c149c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:35216/0 (socket says 172.21.15.17:35216) 2024-04-17T02:22:18.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.554+0000 7f1a1b7fe640 1 -- 172.21.15.17:0/1898158955 learned_addr learned my addr 172.21.15.17:0/1898158955 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:18.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.554+0000 7f1a1bfff640 1 --2- 172.21.15.17:0/1898158955 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a1c14b0a0 0x7f1a1c140770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:18.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.554+0000 7f1a1b7fe640 1 -- 172.21.15.17:0/1898158955 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a1c14b0a0 msgr2=0x7f1a1c140770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:18.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.554+0000 7f1a1b7fe640 1 --2- 172.21.15.17:0/1898158955 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a1c14b0a0 0x7f1a1c140770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:18.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.554+0000 7f1a1b7fe640 1 -- 172.21.15.17:0/1898158955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a1c1496e0 msgr2=0x7f1a1c1da100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:18.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.554+0000 7f1a1b7fe640 1 --2- 172.21.15.17:0/1898158955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a1c1496e0 0x7f1a1c1da100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:18.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.554+0000 7f1a1b7fe640 1 -- 172.21.15.17:0/1898158955 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a1c1daaa0 con 0x7f1a08004800 2024-04-17T02:22:18.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.554+0000 7f1a13fff640 1 --2- 172.21.15.17:0/1898158955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a1c1496e0 0x7f1a1c1da100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:18.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.554+0000 7f1a1bfff640 1 --2- 172.21.15.17:0/1898158955 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a1c14b0a0 0x7f1a1c140770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T02:22:18.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.554+0000 7f1a1b7fe640 1 --2- 172.21.15.17:0/1898158955 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f1a08004800 0x7f1a1c149c20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c0072f0 tx=0x7f1a0c0077b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:18.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.554+0000 7f1a18ff9640 1 -- 172.21.15.17:0/1898158955 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c01a070 con 0x7f1a08004800 2024-04-17T02:22:18.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.555+0000 7f1a18ff9640 1 -- 172.21.15.17:0/1898158955 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a0c00f960 con 0x7f1a08004800 2024-04-17T02:22:18.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.555+0000 7f1a21ce6640 1 -- 172.21.15.17:0/1898158955 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a1c149460 con 0x7f1a08004800 2024-04-17T02:22:18.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.555+0000 7f1a18ff9640 1 -- 172.21.15.17:0/1898158955 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c00fd10 con 0x7f1a08004800 2024-04-17T02:22:18.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.555+0000 7f1a21ce6640 1 -- 172.21.15.17:0/1898158955 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a1c14b520 con 0x7f1a08004800 2024-04-17T02:22:18.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.555+0000 7f1a21ce6640 1 -- 172.21.15.17:0/1898158955 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a1c0687f0 con 0x7f1a08004800 2024-04-17T02:22:18.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.556+0000 7f1a18ff9640 1 -- 172.21.15.17:0/1898158955 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f1a0c01d070 con 0x7f1a08004800 2024-04-17T02:22:18.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.557+0000 7f1a18ff9640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:18.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.557+0000 7f1a18ff9640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:18.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.557+0000 7f1a18ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:18.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.557+0000 7f1a18ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:18.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.557+0000 7f1a18ff9640 1 --2- 172.21.15.17:0/1898158955 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f19fc09f4b0 0x7f19fc0a1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:18.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.557+0000 7f1a13fff640 1 --2- 172.21.15.17:0/1898158955 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f19fc09f4b0 0x7f19fc0a1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:18.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.557+0000 7f1a18ff9640 1 -- 172.21.15.17:0/1898158955 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7f1a0c0c8bb0 con 0x7f1a08004800 2024-04-17T02:22:18.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.558+0000 7f1a13fff640 1 --2- 172.21.15.17:0/1898158955 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f19fc09f4b0 0x7f19fc0a1970 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1a04033000 tx=0x7f1a04009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:18.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.561+0000 7f1a18ff9640 1 -- 172.21.15.17:0/1898158955 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f1a0c097f60 con 0x7f1a08004800 2024-04-17T02:22:18.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.747+0000 7f1a21ce6640 1 -- 172.21.15.17:0/1898158955 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1a1c06c250 con 0x7f1a08004800 2024-04-17T02:22:18.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.748+0000 7f1a18ff9640 1 -- 172.21.15.17:0/1898158955 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+9730 (secure 0 0 0) 0x7f1a0c097860 con 0x7f1a08004800 2024-04-17T02:22:18.749 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:22:18.749 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":16,"fsid":"7cbfae20-b10d-41da-92b7-cbd5c1632e23","created":"2024-04-17T02:22:00.246446+0000","modified":"2024-04-17T02:22:18.117195+0000","last_up_change":"2024-04-17T02:22:09.077928+0000","last_in_change":"2024-04-17T02:22:01.415384+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T02:22:10.533377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-17T02:22:15.947495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2973665c-6c5e-4688-bffe-72d3bdcf467f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6801","nonce":1828284343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6803","nonce":1828284343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6807","nonce":1828284343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6805","nonce":1828284343}]},"public_addr":"172.21.15.17:6801/1828284343","cluster_addr":"172.21.15.17:6803/1828284343","heartbeat_back_addr":"172.21.15.17:6807/1828284343","heartbeat_front_addr":"172.21.15.17:6805/1828284343","state":["exists","up"]},{"osd":1,"uuid":"a59a034d-19b4-47e8-8ca5-538597b4af1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6809","nonce":2064593011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6811","nonce":2064593011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6815","nonce":2064593011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6813","nonce":2064593011}]},"public_addr":"172.21.15.122:6809/2064593011","cluster_addr":"172.21.15.122:6811/2064593011","heartbeat_back_addr":"172.21.15.122:6815/2064593011","heartbeat_front_addr":"172.21.15.122:6813/2064593011","state":["exists","up"]},{"osd":2,"uuid":"070f4c5f-459f-46ff-b980-05b1ac50c951","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6817","nonce":929092547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6819","nonce":929092547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6823","nonce":929092547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6821","nonce":929092547}]},"public_addr":"172.21.15.122:6817/929092547","cluster_addr":"172.21.15.122:6819/929092547","heartbeat_back_addr":"172.21.15.122:6823/929092547","heartbeat_front_addr":"172.21.15.122:6821/929092547","state":["exists","up"]},{"osd":3,"uuid":"96216a49-a7b6-40eb-bc93-cc8c78a5270a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6801","nonce":204132523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6803","nonce":204132523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6807","nonce":204132523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6805","nonce":204132523}]},"public_addr":"172.21.15.122:6801/204132523","cluster_addr":"172.21.15.122:6803/204132523","heartbeat_back_addr":"172.21.15.122:6807/204132523","heartbeat_front_addr":"172.21.15.122:6805/204132523","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.477173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.522791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.590625+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.480698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T02:22:18.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.750+0000 7f1a21ce6640 10 mgrc shutdown 2024-04-17T02:22:18.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.750+0000 7f1a21ce6640 1 -- 172.21.15.17:0/1898158955 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f19fc09f4b0 msgr2=0x7f19fc0a1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:18.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.750+0000 7f1a21ce6640 1 --2- 172.21.15.17:0/1898158955 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f19fc09f4b0 0x7f19fc0a1970 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1a04033000 tx=0x7f1a04009030 comp rx=0 tx=0).stop 2024-04-17T02:22:18.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.750+0000 7f1a21ce6640 1 -- 172.21.15.17:0/1898158955 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f1a08004800 msgr2=0x7f1a1c149c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:18.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.750+0000 7f1a21ce6640 1 --2- 172.21.15.17:0/1898158955 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f1a08004800 0x7f1a1c149c20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c0072f0 tx=0x7f1a0c0077b0 comp rx=0 tx=0).stop 2024-04-17T02:22:18.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.750+0000 7f1a21ce6640 1 -- 172.21.15.17:0/1898158955 shutdown_connections 2024-04-17T02:22:18.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.750+0000 7f1a21ce6640 1 --2- 172.21.15.17:0/1898158955 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f19fc09f4b0 0x7f19fc0a1970 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:18.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.750+0000 7f1a21ce6640 1 --2- 172.21.15.17:0/1898158955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a1c1496e0 0x7f1a1c1da100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:18.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.750+0000 7f1a21ce6640 1 --2- 172.21.15.17:0/1898158955 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a1c14b0a0 0x7f1a1c140770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:18.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.750+0000 7f1a21ce6640 1 --2- 172.21.15.17:0/1898158955 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f1a08004800 0x7f1a1c149c20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:18.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.750+0000 7f1a21ce6640 1 -- 172.21.15.17:0/1898158955 >> 172.21.15.17:0/1898158955 conn(0x7f1a1c0a9b60 msgr2=0x7f1a1c144cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:18.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.750+0000 7f1a21ce6640 1 -- 172.21.15.17:0/1898158955 shutdown_connections 2024-04-17T02:22:18.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.750+0000 7f1a21ce6640 1 -- 172.21.15.17:0/1898158955 wait complete. 2024-04-17T02:22:18.762 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T02:22:10.533377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-17T02:22:15.947495+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-17T02:22:18.762 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T02:22:18.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.867+0000 7f78c4104640 1 Processor -- start 2024-04-17T02:22:18.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.868+0000 7f78c4104640 1 -- start start 2024-04-17T02:22:18.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.868+0000 7f78c4104640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f78bc0ab3b0 0x7f78bc0ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:18.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.868+0000 7f78c4104640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f78bc0a9560 0x7f78bc145730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:18.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.868+0000 7f78c4104640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f78bc0acce0 0x7f78bc145c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:18.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.868+0000 7f78c4104640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f78bc0a7f00 con 0x7f78bc0a9560 2024-04-17T02:22:18.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.868+0000 7f78c4104640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f78bc0abd20 con 0x7f78bc0ab3b0 2024-04-17T02:22:18.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.868+0000 7f78c4104640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f78bc0ac000 con 0x7f78bc0acce0 2024-04-17T02:22:18.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.868+0000 7f78c26a1640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f78bc0acce0 0x7f78bc145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:18.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.868+0000 7f78c169f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f78bc0a9560 0x7f78bc145730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:18.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.869+0000 7f78c26a1640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f78bc0acce0 0x7f78bc145c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:35218/0 (socket says 172.21.15.17:35218) 2024-04-17T02:22:18.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.869+0000 7f78c26a1640 1 -- 172.21.15.17:0/3049304710 learned_addr learned my addr 172.21.15.17:0/3049304710 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:18.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.869+0000 7f78c1ea0640 1 --2- 172.21.15.17:0/3049304710 >> v2:172.21.15.122:3300/0 conn(0x7f78bc0ab3b0 0x7f78bc0ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:18.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.869+0000 7f78c26a1640 1 -- 172.21.15.17:0/3049304710 >> v2:172.21.15.122:3300/0 conn(0x7f78bc0ab3b0 msgr2=0x7f78bc0ac7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:18.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.869+0000 7f78c26a1640 1 --2- 172.21.15.17:0/3049304710 >> v2:172.21.15.122:3300/0 conn(0x7f78bc0ab3b0 0x7f78bc0ac7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:18.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.869+0000 7f78c26a1640 1 -- 172.21.15.17:0/3049304710 >> v2:172.21.15.17:3300/0 conn(0x7f78bc0a9560 msgr2=0x7f78bc145730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:18.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.869+0000 7f78c26a1640 1 --2- 172.21.15.17:0/3049304710 >> v2:172.21.15.17:3300/0 conn(0x7f78bc0a9560 0x7f78bc145730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:18.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.869+0000 7f78c26a1640 1 -- 172.21.15.17:0/3049304710 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78bc0a7960 con 0x7f78bc0acce0 2024-04-17T02:22:18.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.869+0000 7f78c26a1640 1 --2- 172.21.15.17:0/3049304710 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f78bc0acce0 0x7f78bc145c70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f78bc0a7b90 tx=0x7f78b402be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e0e919ec4bbec73 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:18.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.870+0000 7f78c0e9e640 1 -- 172.21.15.17:0/3049304710 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b402c9c0 con 0x7f78bc0acce0 2024-04-17T02:22:18.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.870+0000 7f78c0e9e640 1 -- 172.21.15.17:0/3049304710 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78b402cb60 con 0x7f78bc0acce0 2024-04-17T02:22:18.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.870+0000 7f78c0e9e640 1 -- 172.21.15.17:0/3049304710 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b40343f0 con 0x7f78bc0acce0 2024-04-17T02:22:18.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.870+0000 7f78c4104640 1 -- 172.21.15.17:0/3049304710 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f78bc0acce0 msgr2=0x7f78bc145c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:18.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.870+0000 7f78c4104640 1 --2- 172.21.15.17:0/3049304710 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f78bc0acce0 0x7f78bc145c70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f78bc0a7b90 tx=0x7f78b402be20 comp rx=0 tx=0).stop 2024-04-17T02:22:18.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.870+0000 7f78c4104640 1 -- 172.21.15.17:0/3049304710 shutdown_connections 2024-04-17T02:22:18.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.870+0000 7f78c4104640 1 --2- 172.21.15.17:0/3049304710 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f78bc0acce0 0x7f78bc145c70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:18.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.870+0000 7f78c4104640 1 --2- 172.21.15.17:0/3049304710 >> v2:172.21.15.17:3300/0 conn(0x7f78bc0a9560 0x7f78bc145730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:18.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.870+0000 7f78c4104640 1 --2- 172.21.15.17:0/3049304710 >> v2:172.21.15.122:3300/0 conn(0x7f78bc0ab3b0 0x7f78bc0ac7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:18.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.870+0000 7f78c4104640 1 -- 172.21.15.17:0/3049304710 >> 172.21.15.17:0/3049304710 conn(0x7f78bc0a9b60 msgr2=0x7f78bc0a9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:18.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.870+0000 7f78c4104640 1 -- 172.21.15.17:0/3049304710 shutdown_connections 2024-04-17T02:22:18.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.870+0000 7f78c4104640 1 -- 172.21.15.17:0/3049304710 wait complete. 2024-04-17T02:22:18.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.871+0000 7f78c4104640 1 Processor -- start 2024-04-17T02:22:18.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.871+0000 7f78c4104640 1 -- start start 2024-04-17T02:22:18.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.872+0000 7f78c4104640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78bc0a9560 0x7f78bc1dab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:18.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.872+0000 7f78c4104640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f78bc0ab3b0 0x7f78bc0a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:18.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.872+0000 7f78c4104640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78bc0acce0 0x7f78bc0a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:18.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.872+0000 7f78c4104640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f78bc06b5b0 con 0x7f78bc0a9560 2024-04-17T02:22:18.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.872+0000 7f78c4104640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f78bc1485d0 con 0x7f78bc0acce0 2024-04-17T02:22:18.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.872+0000 7f78c4104640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f78bc0a1810 con 0x7f78bc0ab3b0 2024-04-17T02:22:18.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.872+0000 7f78c1ea0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78bc0a9560 0x7f78bc1dab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:18.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.872+0000 7f78c169f640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f78bc0ab3b0 0x7f78bc0a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:18.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.872+0000 7f78c1ea0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78bc0a9560 0x7f78bc1dab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51502/0 (socket says 172.21.15.17:51502) 2024-04-17T02:22:18.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.872+0000 7f78c1ea0640 1 -- 172.21.15.17:0/3251668648 learned_addr learned my addr 172.21.15.17:0/3251668648 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:18.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.872+0000 7f78c26a1640 1 --2- 172.21.15.17:0/3251668648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78bc0acce0 0x7f78bc0a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:18.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.872+0000 7f78c1ea0640 1 -- 172.21.15.17:0/3251668648 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f78bc0ab3b0 msgr2=0x7f78bc0a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:18.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.872+0000 7f78c1ea0640 1 --2- 172.21.15.17:0/3251668648 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f78bc0ab3b0 0x7f78bc0a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:18.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.872+0000 7f78c1ea0640 1 -- 172.21.15.17:0/3251668648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78bc0acce0 msgr2=0x7f78bc0a12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:18.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.872+0000 7f78c1ea0640 1 --2- 172.21.15.17:0/3251668648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78bc0acce0 0x7f78bc0a12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:18.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.872+0000 7f78c1ea0640 1 -- 172.21.15.17:0/3251668648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78bc0a1fa0 con 0x7f78bc0a9560 2024-04-17T02:22:18.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.872+0000 7f78c169f640 1 --2- 172.21.15.17:0/3251668648 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f78bc0ab3b0 0x7f78bc0a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:18.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.872+0000 7f78c1ea0640 1 --2- 172.21.15.17:0/3251668648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78bc0a9560 0x7f78bc1dab60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f78b800c7f0 tx=0x7f78b800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:18.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.873+0000 7f78b27fc640 1 -- 172.21.15.17:0/3251668648 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b8015070 con 0x7f78bc0a9560 2024-04-17T02:22:18.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.873+0000 7f78b27fc640 1 -- 172.21.15.17:0/3251668648 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78b8004240 con 0x7f78bc0a9560 2024-04-17T02:22:18.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.873+0000 7f78c4104640 1 -- 172.21.15.17:0/3251668648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78bc09d8b0 con 0x7f78bc0a9560 2024-04-17T02:22:18.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.873+0000 7f78b27fc640 1 -- 172.21.15.17:0/3251668648 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b8007620 con 0x7f78bc0a9560 2024-04-17T02:22:18.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.873+0000 7f78c4104640 1 -- 172.21.15.17:0/3251668648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78bc0a1c40 con 0x7f78bc0a9560 2024-04-17T02:22:18.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.874+0000 7f78c4104640 1 -- 172.21.15.17:0/3251668648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78bc0687f0 con 0x7f78bc0a9560 2024-04-17T02:22:18.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.875+0000 7f78b27fc640 1 -- 172.21.15.17:0/3251668648 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f78b80079d0 con 0x7f78bc0a9560 2024-04-17T02:22:18.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.875+0000 7f78b27fc640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:18.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.875+0000 7f78b27fc640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:18.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.875+0000 7f78b27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:18.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.875+0000 7f78b27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:18.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.875+0000 7f78b27fc640 1 --2- 172.21.15.17:0/3251668648 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f78a009f480 0x7f78a00a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:18.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.875+0000 7f78c169f640 1 --2- 172.21.15.17:0/3251668648 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f78a009f480 0x7f78a00a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:18.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.875+0000 7f78b27fc640 1 -- 172.21.15.17:0/3251668648 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7f78b80c94e0 con 0x7f78bc0a9560 2024-04-17T02:22:18.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.876+0000 7f78c169f640 1 --2- 172.21.15.17:0/3251668648 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f78a009f480 0x7f78a00a1940 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f78bc068490 tx=0x7f78ac009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:18.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:18.879+0000 7f78b27fc640 1 -- 172.21.15.17:0/3251668648 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f78b8098890 con 0x7f78bc0a9560 2024-04-17T02:22:19.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.058+0000 7f78c4104640 1 -- 172.21.15.17:0/3251668648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f78bc06c250 con 0x7f78bc0a9560 2024-04-17T02:22:19.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.058+0000 7f78b27fc640 1 -- 172.21.15.17:0/3251668648 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f78b8098190 con 0x7f78bc0a9560 2024-04-17T02:22:19.060 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-04-17T02:22:19.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.060+0000 7f78c4104640 10 mgrc shutdown 2024-04-17T02:22:19.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.060+0000 7f78c4104640 1 -- 172.21.15.17:0/3251668648 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f78a009f480 msgr2=0x7f78a00a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:19.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.060+0000 7f78c4104640 1 --2- 172.21.15.17:0/3251668648 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f78a009f480 0x7f78a00a1940 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f78bc068490 tx=0x7f78ac009190 comp rx=0 tx=0).stop 2024-04-17T02:22:19.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.060+0000 7f78c4104640 1 -- 172.21.15.17:0/3251668648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78bc0a9560 msgr2=0x7f78bc1dab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:19.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.060+0000 7f78c4104640 1 --2- 172.21.15.17:0/3251668648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78bc0a9560 0x7f78bc1dab60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f78b800c7f0 tx=0x7f78b800ccb0 comp rx=0 tx=0).stop 2024-04-17T02:22:19.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.060+0000 7f78c4104640 1 -- 172.21.15.17:0/3251668648 shutdown_connections 2024-04-17T02:22:19.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.060+0000 7f78c4104640 1 --2- 172.21.15.17:0/3251668648 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f78a009f480 0x7f78a00a1940 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:19.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.060+0000 7f78c4104640 1 --2- 172.21.15.17:0/3251668648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78bc0acce0 0x7f78bc0a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:19.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.060+0000 7f78c4104640 1 --2- 172.21.15.17:0/3251668648 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f78bc0ab3b0 0x7f78bc0a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:19.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.060+0000 7f78c4104640 1 --2- 172.21.15.17:0/3251668648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78bc0a9560 0x7f78bc1dab60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:19.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.060+0000 7f78c4104640 1 -- 172.21.15.17:0/3251668648 >> 172.21.15.17:0/3251668648 conn(0x7f78bc0a9b60 msgr2=0x7f78bc0a8080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:19.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.060+0000 7f78c4104640 1 -- 172.21.15.17:0/3251668648 shutdown_connections 2024-04-17T02:22:19.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.061+0000 7f78c4104640 1 -- 172.21.15.17:0/3251668648 wait complete. 2024-04-17T02:22:19.072 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-17T02:22:19.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.181+0000 7f5d267c6640 1 Processor -- start 2024-04-17T02:22:19.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.181+0000 7f5d267c6640 1 -- start start 2024-04-17T02:22:19.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.181+0000 7f5d267c6640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5d200ab5b0 0x7f5d200ac680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:19.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.181+0000 7f5d267c6640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f5d20142c90 0x7f5d2014fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:19.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.181+0000 7f5d267c6640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d200acea0 con 0x7f5d200bb460 2024-04-17T02:22:19.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.181+0000 7f5d267c6640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f5d200ab990 con 0x7f5d20142c90 2024-04-17T02:22:19.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.181+0000 7f5d267c6640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f5d2006c330 con 0x7f5d200ab5b0 2024-04-17T02:22:19.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.181+0000 7f5d24d63640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f5d20142c90 0x7f5d2014fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:19.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.181+0000 7f5d24d63640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f5d20142c90 0x7f5d2014fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51514/0 (socket says 172.21.15.17:51514) 2024-04-17T02:22:19.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.181+0000 7f5d24d63640 1 -- 172.21.15.17:0/2195598470 learned_addr learned my addr 172.21.15.17:0/2195598470 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:19.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.181+0000 7f5d17fff640 1 --1- 172.21.15.17:0/2195598470 >> v1:172.21.15.17:6789/0 conn(0x7f5d200bb460 0x7f5d20142580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53842/0 (socket says 172.21.15.17:53842) 2024-04-17T02:22:19.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.182+0000 7f5d1ffff640 1 --2- 172.21.15.17:0/2195598470 >> v2:172.21.15.122:3300/0 conn(0x7f5d200ab5b0 0x7f5d200ac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:19.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.182+0000 7f5d24d63640 1 -- 172.21.15.17:0/2195598470 >> v2:172.21.15.122:3300/0 conn(0x7f5d200ab5b0 msgr2=0x7f5d200ac680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:19.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.182+0000 7f5d24d63640 1 --2- 172.21.15.17:0/2195598470 >> v2:172.21.15.122:3300/0 conn(0x7f5d200ab5b0 0x7f5d200ac680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:19.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.182+0000 7f5d24d63640 1 -- 172.21.15.17:0/2195598470 >> v1:172.21.15.17:6789/0 conn(0x7f5d200bb460 legacy=0x7f5d20142580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:19.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.182+0000 7f5d1f7fe640 1 -- 172.21.15.17:0/2195598470 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2731099870 0 0) 0x7f5d200acea0 con 0x7f5d200bb460 2024-04-17T02:22:19.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.182+0000 7f5d24d63640 1 -- 172.21.15.17:0/2195598470 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d200acbc0 con 0x7f5d20142c90 2024-04-17T02:22:19.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.182+0000 7f5d1ffff640 1 --2- 172.21.15.17:0/2195598470 >> v2:172.21.15.122:3300/0 conn(0x7f5d200ab5b0 0x7f5d200ac680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T02:22:19.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.182+0000 7f5d24d63640 1 --2- 172.21.15.17:0/2195598470 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d20142c90 0x7f5d2014fa90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5d2006cde0 tx=0x7f5d1802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e72286f3fb0d9dc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:19.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.183+0000 7f5d1f7fe640 1 -- 172.21.15.17:0/2195598470 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1802cb20 con 0x7f5d20142c90 2024-04-17T02:22:19.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.183+0000 7f5d1f7fe640 1 -- 172.21.15.17:0/2195598470 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d1802ccc0 con 0x7f5d20142c90 2024-04-17T02:22:19.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.183+0000 7f5d1f7fe640 1 -- 172.21.15.17:0/2195598470 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d18034610 con 0x7f5d20142c90 2024-04-17T02:22:19.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.183+0000 7f5d267c6640 1 -- 172.21.15.17:0/2195598470 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d20142c90 msgr2=0x7f5d2014fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:19.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.183+0000 7f5d267c6640 1 --2- 172.21.15.17:0/2195598470 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d20142c90 0x7f5d2014fa90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5d2006cde0 tx=0x7f5d1802bf80 comp rx=0 tx=0).stop 2024-04-17T02:22:19.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.183+0000 7f5d267c6640 1 -- 172.21.15.17:0/2195598470 shutdown_connections 2024-04-17T02:22:19.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.183+0000 7f5d267c6640 1 --2- 172.21.15.17:0/2195598470 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d20142c90 0x7f5d2014fa90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:19.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.183+0000 7f5d267c6640 1 --2- 172.21.15.17:0/2195598470 >> v2:172.21.15.122:3300/0 conn(0x7f5d200ab5b0 0x7f5d200ac680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:19.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.183+0000 7f5d267c6640 1 -- 172.21.15.17:0/2195598470 >> 172.21.15.17:0/2195598470 conn(0x7f5d200ba940 msgr2=0x7f5d200bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:19.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.183+0000 7f5d267c6640 1 -- 172.21.15.17:0/2195598470 shutdown_connections 2024-04-17T02:22:19.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.183+0000 7f5d267c6640 1 -- 172.21.15.17:0/2195598470 wait complete. 2024-04-17T02:22:19.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.184+0000 7f5d267c6640 1 Processor -- start 2024-04-17T02:22:19.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.184+0000 7f5d267c6640 1 -- start start 2024-04-17T02:22:19.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.185+0000 7f5d267c6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d200ab5b0 0x7f5d2013c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:19.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.185+0000 7f5d267c6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d200bb460 0x7f5d20148480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:19.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.185+0000 7f5d267c6640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f5d20142c90 0x7f5d20147a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:19.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.185+0000 7f5d267c6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5d200a9700 con 0x7f5d200bb460 2024-04-17T02:22:19.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.185+0000 7f5d267c6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5d200a7400 con 0x7f5d200ab5b0 2024-04-17T02:22:19.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.185+0000 7f5d267c6640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f5d200a9880 con 0x7f5d20142c90 2024-04-17T02:22:19.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.185+0000 7f5d17fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d200bb460 0x7f5d20148480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:19.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.185+0000 7f5d24d63640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f5d20142c90 0x7f5d20147a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:19.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.185+0000 7f5d24d63640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f5d20142c90 0x7f5d20147a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:35236/0 (socket says 172.21.15.17:35236) 2024-04-17T02:22:19.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.185+0000 7f5d17fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d200bb460 0x7f5d20148480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51530/0 (socket says 172.21.15.17:51530) 2024-04-17T02:22:19.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.185+0000 7f5d24d63640 1 -- 172.21.15.17:0/1769658277 learned_addr learned my addr 172.21.15.17:0/1769658277 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:19.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.185+0000 7f5d1ffff640 1 --2- 172.21.15.17:0/1769658277 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d200ab5b0 0x7f5d2013c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:19.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.185+0000 7f5d17fff640 1 -- 172.21.15.17:0/1769658277 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f5d20142c90 msgr2=0x7f5d20147a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:19.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.185+0000 7f5d17fff640 1 --2- 172.21.15.17:0/1769658277 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f5d20142c90 0x7f5d20147a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:19.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.185+0000 7f5d17fff640 1 -- 172.21.15.17:0/1769658277 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d200ab5b0 msgr2=0x7f5d2013c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:19.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.185+0000 7f5d17fff640 1 --2- 172.21.15.17:0/1769658277 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d200ab5b0 0x7f5d2013c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:19.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.185+0000 7f5d17fff640 1 -- 172.21.15.17:0/1769658277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d201489c0 con 0x7f5d200bb460 2024-04-17T02:22:19.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.185+0000 7f5d24d63640 1 --2- 172.21.15.17:0/1769658277 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f5d20142c90 0x7f5d20147a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:19.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.185+0000 7f5d17fff640 1 --2- 172.21.15.17:0/1769658277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d200bb460 0x7f5d20148480 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5d200bb8c0 tx=0x7f5d0800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:19.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.186+0000 7f5d1d7fa640 1 -- 172.21.15.17:0/1769658277 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d080074e0 con 0x7f5d200bb460 2024-04-17T02:22:19.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.186+0000 7f5d1d7fa640 1 -- 172.21.15.17:0/1769658277 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d080047e0 con 0x7f5d200bb460 2024-04-17T02:22:19.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.186+0000 7f5d267c6640 1 -- 172.21.15.17:0/1769658277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d201ddf70 con 0x7f5d200bb460 2024-04-17T02:22:19.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.186+0000 7f5d1d7fa640 1 -- 172.21.15.17:0/1769658277 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d08004bd0 con 0x7f5d200bb460 2024-04-17T02:22:19.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.186+0000 7f5d267c6640 1 -- 172.21.15.17:0/1769658277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d2013d1f0 con 0x7f5d200bb460 2024-04-17T02:22:19.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.187+0000 7f5d267c6640 1 -- 172.21.15.17:0/1769658277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d200682b0 con 0x7f5d200bb460 2024-04-17T02:22:19.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.188+0000 7f5d1d7fa640 1 -- 172.21.15.17:0/1769658277 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f5d08011070 con 0x7f5d200bb460 2024-04-17T02:22:19.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.188+0000 7f5d1d7fa640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:19.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.188+0000 7f5d1d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:19.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.188+0000 7f5d1d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:19.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.188+0000 7f5d1d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:19.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.188+0000 7f5d1d7fa640 1 --2- 172.21.15.17:0/1769658277 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f5d0009f480 0x7f5d000a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:19.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.188+0000 7f5d1ffff640 1 --2- 172.21.15.17:0/1769658277 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f5d0009f480 0x7f5d000a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:19.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.188+0000 7f5d1d7fa640 1 -- 172.21.15.17:0/1769658277 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7f5d080c8d30 con 0x7f5d200bb460 2024-04-17T02:22:19.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.189+0000 7f5d1ffff640 1 --2- 172.21.15.17:0/1769658277 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f5d0009f480 0x7f5d000a1940 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5d10006fd0 tx=0x7f5d10008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:19.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.192+0000 7f5d1d7fa640 1 -- 172.21.15.17:0/1769658277 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f5d200682b0 con 0x7f5d200bb460 2024-04-17T02:22:19.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.373+0000 7f5d267c6640 1 -- 172.21.15.17:0/1769658277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) -- 0x7f5d200687f0 con 0x7f5d200bb460 2024-04-17T02:22:19.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.373+0000 7f5d1d7fa640 1 -- 172.21.15.17:0/1769658277 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) ==== 92+0+10 (secure 0 0 0) 0x7f5d080980e0 con 0x7f5d200bb460 2024-04-17T02:22:19.374 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2024-04-17T02:22:19.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.375+0000 7f5d267c6640 10 mgrc shutdown 2024-04-17T02:22:19.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.375+0000 7f5d267c6640 1 -- 172.21.15.17:0/1769658277 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f5d0009f480 msgr2=0x7f5d000a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:19.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.375+0000 7f5d267c6640 1 --2- 172.21.15.17:0/1769658277 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f5d0009f480 0x7f5d000a1940 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5d10006fd0 tx=0x7f5d10008040 comp rx=0 tx=0).stop 2024-04-17T02:22:19.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.375+0000 7f5d267c6640 1 -- 172.21.15.17:0/1769658277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d200bb460 msgr2=0x7f5d20148480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:19.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.375+0000 7f5d267c6640 1 --2- 172.21.15.17:0/1769658277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d200bb460 0x7f5d20148480 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5d200bb8c0 tx=0x7f5d0800c8e0 comp rx=0 tx=0).stop 2024-04-17T02:22:19.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.375+0000 7f5d267c6640 1 -- 172.21.15.17:0/1769658277 shutdown_connections 2024-04-17T02:22:19.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.375+0000 7f5d267c6640 1 --2- 172.21.15.17:0/1769658277 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f5d0009f480 0x7f5d000a1940 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:19.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.375+0000 7f5d267c6640 1 --2- 172.21.15.17:0/1769658277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d200bb460 0x7f5d20148480 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:19.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.375+0000 7f5d267c6640 1 --2- 172.21.15.17:0/1769658277 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f5d20142c90 0x7f5d20147a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:19.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.375+0000 7f5d267c6640 1 --2- 172.21.15.17:0/1769658277 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d200ab5b0 0x7f5d2013c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:19.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.375+0000 7f5d267c6640 1 -- 172.21.15.17:0/1769658277 >> 172.21.15.17:0/1769658277 conn(0x7f5d200ba940 msgr2=0x7f5d200a8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:19.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.375+0000 7f5d267c6640 1 -- 172.21.15.17:0/1769658277 shutdown_connections 2024-04-17T02:22:19.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.375+0000 7f5d267c6640 1 -- 172.21.15.17:0/1769658277 wait complete. 2024-04-17T02:22:19.387 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-17T02:22:19.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.489+0000 7f33c6f56640 1 Processor -- start 2024-04-17T02:22:19.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.490+0000 7f33c6f56640 1 -- start start 2024-04-17T02:22:19.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.490+0000 7f33c6f56640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f33c006d5c0 0x7f33c0143510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:19.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.490+0000 7f33c6f56640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f33c00a1750 0x7f33c0143a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:19.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.490+0000 7f33c6f56640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33c00a1c60 con 0x7f33c00a0520 2024-04-17T02:22:19.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.490+0000 7f33c6f56640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f33c00a0900 con 0x7f33c00a1750 2024-04-17T02:22:19.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.490+0000 7f33c6f56640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f33c00a1000 con 0x7f33c006d5c0 2024-04-17T02:22:19.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.490+0000 7f33c54f3640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f33c00a1750 0x7f33c0143a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:19.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.490+0000 7f33c54f3640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f33c00a1750 0x7f33c0143a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51534/0 (socket says 172.21.15.17:51534) 2024-04-17T02:22:19.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.490+0000 7f33c54f3640 1 -- 172.21.15.17:0/571697111 learned_addr learned my addr 172.21.15.17:0/571697111 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:19.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.490+0000 7f33bffff640 1 --2- 172.21.15.17:0/571697111 >> v2:172.21.15.122:3300/0 conn(0x7f33c006d5c0 0x7f33c0143510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:19.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.491+0000 7f33c54f3640 1 -- 172.21.15.17:0/571697111 >> v2:172.21.15.122:3300/0 conn(0x7f33c006d5c0 msgr2=0x7f33c0143510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:19.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.491+0000 7f33c54f3640 1 --2- 172.21.15.17:0/571697111 >> v2:172.21.15.122:3300/0 conn(0x7f33c006d5c0 0x7f33c0143510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:19.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.491+0000 7f33c54f3640 1 -- 172.21.15.17:0/571697111 >> v1:172.21.15.122:6789/0 conn(0x7f33c00a0520 legacy=0x7f33c006c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:19.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.491+0000 7f33c54f3640 1 -- 172.21.15.17:0/571697111 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33c00a1f20 con 0x7f33c00a1750 2024-04-17T02:22:19.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.491+0000 7f33c54f3640 1 --2- 172.21.15.17:0/571697111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33c00a1750 0x7f33c0143a50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f33c00a1180 tx=0x7f33b802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8418988c452e0f82 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:19.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.491+0000 7f33bf7fe640 1 -- 172.21.15.17:0/571697111 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b802ca70 con 0x7f33c00a1750 2024-04-17T02:22:19.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.491+0000 7f33bf7fe640 1 -- 172.21.15.17:0/571697111 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33b802cc10 con 0x7f33c00a1750 2024-04-17T02:22:19.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.491+0000 7f33bf7fe640 1 -- 172.21.15.17:0/571697111 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b80343f0 con 0x7f33c00a1750 2024-04-17T02:22:19.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.492+0000 7f33c6f56640 1 -- 172.21.15.17:0/571697111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33c00a1750 msgr2=0x7f33c0143a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:19.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.492+0000 7f33c6f56640 1 --2- 172.21.15.17:0/571697111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33c00a1750 0x7f33c0143a50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f33c00a1180 tx=0x7f33b802bed0 comp rx=0 tx=0).stop 2024-04-17T02:22:19.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.492+0000 7f33c6f56640 1 -- 172.21.15.17:0/571697111 shutdown_connections 2024-04-17T02:22:19.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.492+0000 7f33c6f56640 1 --2- 172.21.15.17:0/571697111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33c00a1750 0x7f33c0143a50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:19.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.492+0000 7f33c6f56640 1 --2- 172.21.15.17:0/571697111 >> v2:172.21.15.122:3300/0 conn(0x7f33c006d5c0 0x7f33c0143510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:19.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.492+0000 7f33c6f56640 1 -- 172.21.15.17:0/571697111 >> 172.21.15.17:0/571697111 conn(0x7f33c00748d0 msgr2=0x7f33c00a59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:19.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.492+0000 7f33c6f56640 1 -- 172.21.15.17:0/571697111 shutdown_connections 2024-04-17T02:22:19.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.492+0000 7f33c6f56640 1 -- 172.21.15.17:0/571697111 wait complete. 2024-04-17T02:22:19.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.493+0000 7f33c6f56640 1 Processor -- start 2024-04-17T02:22:19.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.493+0000 7f33c6f56640 1 -- start start 2024-04-17T02:22:19.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.494+0000 7f33c6f56640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f33c006d5c0 0x7f33c0139520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:19.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.494+0000 7f33c6f56640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33c00a0520 0x7f33c0070880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:19.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.494+0000 7f33c6f56640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33c00a1750 0x7f33c0070dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:19.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.494+0000 7f33c6f56640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f33c00a5430 con 0x7f33c00a1750 2024-04-17T02:22:19.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.494+0000 7f33c6f56640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f33c00a52b0 con 0x7f33c00a0520 2024-04-17T02:22:19.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.494+0000 7f33c6f56640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f33c014d710 con 0x7f33c006d5c0 2024-04-17T02:22:19.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.494+0000 7f33c54f3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33c00a1750 0x7f33c0070dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:19.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.494+0000 7f33c4cf2640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f33c006d5c0 0x7f33c0139520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:19.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.494+0000 7f33c54f3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33c00a1750 0x7f33c0070dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51550/0 (socket says 172.21.15.17:51550) 2024-04-17T02:22:19.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.494+0000 7f33c54f3640 1 -- 172.21.15.17:0/523801397 learned_addr learned my addr 172.21.15.17:0/523801397 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:19.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.494+0000 7f33bffff640 1 --2- 172.21.15.17:0/523801397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33c00a0520 0x7f33c0070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:19.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.494+0000 7f33c54f3640 1 -- 172.21.15.17:0/523801397 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f33c006d5c0 msgr2=0x7f33c0139520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:19.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.494+0000 7f33c54f3640 1 --2- 172.21.15.17:0/523801397 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f33c006d5c0 0x7f33c0139520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:19.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.494+0000 7f33c54f3640 1 -- 172.21.15.17:0/523801397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33c00a0520 msgr2=0x7f33c0070880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:19.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.494+0000 7f33c54f3640 1 --2- 172.21.15.17:0/523801397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33c00a0520 0x7f33c0070880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:19.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.494+0000 7f33c54f3640 1 -- 172.21.15.17:0/523801397 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33c0136860 con 0x7f33c00a1750 2024-04-17T02:22:19.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.494+0000 7f33bffff640 1 --2- 172.21.15.17:0/523801397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33c00a0520 0x7f33c0070880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T02:22:19.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.494+0000 7f33c54f3640 1 --2- 172.21.15.17:0/523801397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33c00a1750 0x7f33c0070dc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f33b8009f10 tx=0x7f33b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:19.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.494+0000 7f33bd7fa640 1 -- 172.21.15.17:0/523801397 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b8043020 con 0x7f33c00a1750 2024-04-17T02:22:19.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.494+0000 7f33bd7fa640 1 -- 172.21.15.17:0/523801397 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33b803e450 con 0x7f33c00a1750 2024-04-17T02:22:19.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.494+0000 7f33c6f56640 1 -- 172.21.15.17:0/523801397 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33c0136b20 con 0x7f33c00a1750 2024-04-17T02:22:19.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.494+0000 7f33bd7fa640 1 -- 172.21.15.17:0/523801397 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b8009510 con 0x7f33c00a1750 2024-04-17T02:22:19.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.495+0000 7f33c6f56640 1 -- 172.21.15.17:0/523801397 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33c0140970 con 0x7f33c00a1750 2024-04-17T02:22:19.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.496+0000 7f33c6f56640 1 -- 172.21.15.17:0/523801397 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33c00687f0 con 0x7f33c00a1750 2024-04-17T02:22:19.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.497+0000 7f33bd7fa640 1 -- 172.21.15.17:0/523801397 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f33b8046020 con 0x7f33c00a1750 2024-04-17T02:22:19.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.497+0000 7f33bd7fa640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:19.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.497+0000 7f33bd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:19.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.497+0000 7f33bd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:19.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.497+0000 7f33bd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:19.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.497+0000 7f33bd7fa640 1 --2- 172.21.15.17:0/523801397 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f33a409f480 0x7f33a40a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:19.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.497+0000 7f33c4cf2640 1 --2- 172.21.15.17:0/523801397 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f33a409f480 0x7f33a40a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:19.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.497+0000 7f33bd7fa640 1 -- 172.21.15.17:0/523801397 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7f33b80eb970 con 0x7f33c00a1750 2024-04-17T02:22:19.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.498+0000 7f33c4cf2640 1 --2- 172.21.15.17:0/523801397 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f33a409f480 0x7f33a40a1940 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f33b4004f60 tx=0x7f33b4007e30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:19.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.501+0000 7f33bd7fa640 1 -- 172.21.15.17:0/523801397 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f33b804d030 con 0x7f33c00a1750 2024-04-17T02:22:19.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.685+0000 7f33c6f56640 1 -- 172.21.15.17:0/523801397 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f33c00b5ad0 con 0x7f33c00a1750 2024-04-17T02:22:19.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.686+0000 7f33bd7fa640 1 -- 172.21.15.17:0/523801397 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+126 (secure 0 0 0) 0x7f33b80bad20 con 0x7f33c00a1750 2024-04-17T02:22:19.687 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:22:19.687 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2024-04-17T02:22:19.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-04-17T02:22:19.687 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2024-04-17T02:22:19.687 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2024-04-17T02:22:19.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-04-17T02:22:19.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-04-17T02:22:19.688 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 2, 2024-04-17T02:22:19.688 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": "rbd" 2024-04-17T02:22:19.688 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-04-17T02:22:19.688 INFO:teuthology.orchestra.run.smithi017.stdout:] 2024-04-17T02:22:19.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.687+0000 7f33c6f56640 10 mgrc shutdown 2024-04-17T02:22:19.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.687+0000 7f33c6f56640 1 -- 172.21.15.17:0/523801397 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f33a409f480 msgr2=0x7f33a40a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:19.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.687+0000 7f33c6f56640 1 --2- 172.21.15.17:0/523801397 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f33a409f480 0x7f33a40a1940 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f33b4004f60 tx=0x7f33b4007e30 comp rx=0 tx=0).stop 2024-04-17T02:22:19.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.687+0000 7f33c6f56640 1 -- 172.21.15.17:0/523801397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33c00a1750 msgr2=0x7f33c0070dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:19.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.687+0000 7f33c6f56640 1 --2- 172.21.15.17:0/523801397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33c00a1750 0x7f33c0070dc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f33b8009f10 tx=0x7f33b8004a40 comp rx=0 tx=0).stop 2024-04-17T02:22:19.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.688+0000 7f33c6f56640 1 -- 172.21.15.17:0/523801397 shutdown_connections 2024-04-17T02:22:19.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.688+0000 7f33c6f56640 1 --2- 172.21.15.17:0/523801397 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f33a409f480 0x7f33a40a1940 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:19.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.688+0000 7f33c6f56640 1 --2- 172.21.15.17:0/523801397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33c00a1750 0x7f33c0070dc0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:19.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.688+0000 7f33c6f56640 1 --2- 172.21.15.17:0/523801397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33c00a0520 0x7f33c0070880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:19.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.688+0000 7f33c6f56640 1 --2- 172.21.15.17:0/523801397 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f33c006d5c0 0x7f33c0139520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:19.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.688+0000 7f33c6f56640 1 -- 172.21.15.17:0/523801397 >> 172.21.15.17:0/523801397 conn(0x7f33c00748d0 msgr2=0x7f33c0142720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:19.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.688+0000 7f33c6f56640 1 -- 172.21.15.17:0/523801397 shutdown_connections 2024-04-17T02:22:19.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.688+0000 7f33c6f56640 1 -- 172.21.15.17:0/523801397 wait complete. 2024-04-17T02:22:19.699 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-17T02:22:19.700 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-17T02:22:19.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.806+0000 7fd63ba0d640 1 Processor -- start 2024-04-17T02:22:19.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.806+0000 7fd63ba0d640 1 -- start start 2024-04-17T02:22:19.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.807+0000 7fd63ba0d640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd6340ab450 0x7fd634145150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:19.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.807+0000 7fd63ba0d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd63406b7f0 0x7fd6340acb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:19.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.807+0000 7fd63ba0d640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6341457f0 con 0x7fd6340a87f0 2024-04-17T02:22:19.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.807+0000 7fd63ba0d640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fd6340ad040 con 0x7fd63406b7f0 2024-04-17T02:22:19.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.807+0000 7fd63ba0d640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fd634145a90 con 0x7fd6340ab450 2024-04-17T02:22:19.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.807+0000 7fd6397a9640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd6340ab450 0x7fd634145150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:19.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.807+0000 7fd638fa8640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd63406b7f0 0x7fd6340acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:19.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.807+0000 7fd638fa8640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd63406b7f0 0x7fd6340acb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51566/0 (socket says 172.21.15.17:51566) 2024-04-17T02:22:19.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.807+0000 7fd6397a9640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd6340ab450 0x7fd634145150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:35244/0 (socket says 172.21.15.17:35244) 2024-04-17T02:22:19.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.807+0000 7fd638fa8640 1 -- 172.21.15.17:0/1564807456 learned_addr learned my addr 172.21.15.17:0/1564807456 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:19.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.807+0000 7fd638fa8640 1 -- 172.21.15.17:0/1564807456 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd6340ab450 msgr2=0x7fd634145150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:19.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.807+0000 7fd638fa8640 1 --2- 172.21.15.17:0/1564807456 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd6340ab450 0x7fd634145150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:19.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.807+0000 7fd638fa8640 1 -- 172.21.15.17:0/1564807456 >> v1:172.21.15.122:6789/0 conn(0x7fd6340a87f0 legacy=0x7fd6340a8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:19.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.807+0000 7fd638fa8640 1 -- 172.21.15.17:0/1564807456 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6340a9380 con 0x7fd63406b7f0 2024-04-17T02:22:19.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.807+0000 7fd6397a9640 1 --2- 172.21.15.17:0/1564807456 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd6340ab450 0x7fd634145150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:19.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.808+0000 7fd638fa8640 1 --2- 172.21.15.17:0/1564807456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd63406b7f0 0x7fd6340acb00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd628009870 tx=0x7fd62802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68644b0b7f664726 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:19.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.808+0000 7fd633fff640 1 -- 172.21.15.17:0/1564807456 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd628035020 con 0x7fd63406b7f0 2024-04-17T02:22:19.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.808+0000 7fd633fff640 1 -- 172.21.15.17:0/1564807456 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd628031640 con 0x7fd63406b7f0 2024-04-17T02:22:19.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.808+0000 7fd633fff640 1 -- 172.21.15.17:0/1564807456 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62802d040 con 0x7fd63406b7f0 2024-04-17T02:22:19.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.809+0000 7fd63ba0d640 1 -- 172.21.15.17:0/1564807456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd63406b7f0 msgr2=0x7fd6340acb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:19.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.809+0000 7fd63ba0d640 1 --2- 172.21.15.17:0/1564807456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd63406b7f0 0x7fd6340acb00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd628009870 tx=0x7fd62802b8f0 comp rx=0 tx=0).stop 2024-04-17T02:22:19.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.809+0000 7fd63ba0d640 1 -- 172.21.15.17:0/1564807456 shutdown_connections 2024-04-17T02:22:19.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.809+0000 7fd63ba0d640 1 --2- 172.21.15.17:0/1564807456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd63406b7f0 0x7fd6340acb00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:19.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.809+0000 7fd63ba0d640 1 --2- 172.21.15.17:0/1564807456 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd6340ab450 0x7fd634145150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:19.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.809+0000 7fd63ba0d640 1 -- 172.21.15.17:0/1564807456 >> 172.21.15.17:0/1564807456 conn(0x7fd6340a99e0 msgr2=0x7fd6340a9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:19.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.809+0000 7fd63ba0d640 1 -- 172.21.15.17:0/1564807456 shutdown_connections 2024-04-17T02:22:19.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.809+0000 7fd63ba0d640 1 -- 172.21.15.17:0/1564807456 wait complete. 2024-04-17T02:22:19.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.810+0000 7fd63ba0d640 1 Processor -- start 2024-04-17T02:22:19.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.810+0000 7fd63ba0d640 1 -- start start 2024-04-17T02:22:19.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.810+0000 7fd63ba0d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd63406b7f0 0x7fd6340b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:19.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.811+0000 7fd63ba0d640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd6340a87f0 0x7fd6341d0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:19.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.811+0000 7fd63ba0d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6340ab450 0x7fd6340afa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:19.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.811+0000 7fd63ba0d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd6340aade0 con 0x7fd6340ab450 2024-04-17T02:22:19.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.811+0000 7fd63ba0d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd6340ab830 con 0x7fd63406b7f0 2024-04-17T02:22:19.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.811+0000 7fd63ba0d640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fd6340aaf60 con 0x7fd6340a87f0 2024-04-17T02:22:19.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.811+0000 7fd638fa8640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd6340a87f0 0x7fd6341d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:19.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.811+0000 7fd639faa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6340ab450 0x7fd6340afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:19.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.811+0000 7fd638fa8640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd6340a87f0 0x7fd6341d0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:35254/0 (socket says 172.21.15.17:35254) 2024-04-17T02:22:19.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.811+0000 7fd638fa8640 1 -- 172.21.15.17:0/1449192888 learned_addr learned my addr 172.21.15.17:0/1449192888 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:19.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.811+0000 7fd6397a9640 1 --2- 172.21.15.17:0/1449192888 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd63406b7f0 0x7fd6340b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:19.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.811+0000 7fd639faa640 1 -- 172.21.15.17:0/1449192888 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd6340a87f0 msgr2=0x7fd6341d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:19.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.811+0000 7fd639faa640 1 --2- 172.21.15.17:0/1449192888 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd6340a87f0 0x7fd6341d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:19.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.811+0000 7fd639faa640 1 -- 172.21.15.17:0/1449192888 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd63406b7f0 msgr2=0x7fd6340b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:19.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.811+0000 7fd639faa640 1 --2- 172.21.15.17:0/1449192888 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd63406b7f0 0x7fd6340b11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:19.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.811+0000 7fd639faa640 1 -- 172.21.15.17:0/1449192888 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6341d0c10 con 0x7fd6340ab450 2024-04-17T02:22:19.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.811+0000 7fd638fa8640 1 --2- 172.21.15.17:0/1449192888 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd6340a87f0 0x7fd6341d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:19.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.811+0000 7fd639faa640 1 --2- 172.21.15.17:0/1449192888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6340ab450 0x7fd6340afa50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00c730 tx=0x7fd62c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:19.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.811+0000 7fd631ffb640 1 -- 172.21.15.17:0/1449192888 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c016020 con 0x7fd6340ab450 2024-04-17T02:22:19.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.811+0000 7fd631ffb640 1 -- 172.21.15.17:0/1449192888 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd62c006d50 con 0x7fd6340ab450 2024-04-17T02:22:19.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.811+0000 7fd63ba0d640 1 -- 172.21.15.17:0/1449192888 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6341d0eb0 con 0x7fd6340ab450 2024-04-17T02:22:19.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.811+0000 7fd631ffb640 1 -- 172.21.15.17:0/1449192888 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c003bb0 con 0x7fd6340ab450 2024-04-17T02:22:19.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.812+0000 7fd63ba0d640 1 -- 172.21.15.17:0/1449192888 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6340b81e0 con 0x7fd6340ab450 2024-04-17T02:22:19.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.812+0000 7fd63ba0d640 1 -- 172.21.15.17:0/1449192888 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd634068890 con 0x7fd6340ab450 2024-04-17T02:22:19.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.814+0000 7fd631ffb640 1 -- 172.21.15.17:0/1449192888 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7fd62c0050d0 con 0x7fd6340ab450 2024-04-17T02:22:19.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.814+0000 7fd631ffb640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:19.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.814+0000 7fd631ffb640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:19.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.814+0000 7fd631ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:19.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.814+0000 7fd631ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:19.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.814+0000 7fd631ffb640 1 --2- 172.21.15.17:0/1449192888 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fd62009f4b0 0x7fd6200a1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:19.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.814+0000 7fd6397a9640 1 --2- 172.21.15.17:0/1449192888 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fd62009f4b0 0x7fd6200a1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:19.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.814+0000 7fd631ffb640 1 -- 172.21.15.17:0/1449192888 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7fd62c0c9b50 con 0x7fd6340ab450 2024-04-17T02:22:19.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.815+0000 7fd6397a9640 1 --2- 172.21.15.17:0/1449192888 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fd62009f4b0 0x7fd6200a1970 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd624009a30 tx=0x7fd624008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:19.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.817+0000 7fd631ffb640 1 -- 172.21.15.17:0/1449192888 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fd62c020020 con 0x7fd6340ab450 2024-04-17T02:22:19.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:19.997+0000 7fd63ba0d640 1 -- 172.21.15.17:0/1449192888 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd63406c370 con 0x7fd6340ab450 2024-04-17T02:22:20.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.233+0000 7fd631ffb640 1 -- 172.21.15.17:0/1449192888 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7fd62c099020 con 0x7fd6340ab450 2024-04-17T02:22:20.234 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2024-04-17T02:22:20.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.237+0000 7fd63ba0d640 10 mgrc shutdown 2024-04-17T02:22:20.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.237+0000 7fd63ba0d640 1 -- 172.21.15.17:0/1449192888 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fd62009f4b0 msgr2=0x7fd6200a1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:20.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.237+0000 7fd63ba0d640 1 --2- 172.21.15.17:0/1449192888 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fd62009f4b0 0x7fd6200a1970 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd624009a30 tx=0x7fd624008040 comp rx=0 tx=0).stop 2024-04-17T02:22:20.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.237+0000 7fd63ba0d640 1 -- 172.21.15.17:0/1449192888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6340ab450 msgr2=0x7fd6340afa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:20.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.237+0000 7fd63ba0d640 1 --2- 172.21.15.17:0/1449192888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6340ab450 0x7fd6340afa50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00c730 tx=0x7fd62c00cbf0 comp rx=0 tx=0).stop 2024-04-17T02:22:20.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.237+0000 7fd63ba0d640 1 -- 172.21.15.17:0/1449192888 shutdown_connections 2024-04-17T02:22:20.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.237+0000 7fd63ba0d640 1 --2- 172.21.15.17:0/1449192888 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fd62009f4b0 0x7fd6200a1970 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:20.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.237+0000 7fd63ba0d640 1 --2- 172.21.15.17:0/1449192888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6340ab450 0x7fd6340afa50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:20.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.237+0000 7fd63ba0d640 1 --2- 172.21.15.17:0/1449192888 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd6340a87f0 0x7fd6341d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:20.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.237+0000 7fd63ba0d640 1 --2- 172.21.15.17:0/1449192888 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd63406b7f0 0x7fd6340b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:20.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.237+0000 7fd63ba0d640 1 -- 172.21.15.17:0/1449192888 >> 172.21.15.17:0/1449192888 conn(0x7fd6340a99e0 msgr2=0x7fd6340b9a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:20.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.237+0000 7fd63ba0d640 1 -- 172.21.15.17:0/1449192888 shutdown_connections 2024-04-17T02:22:20.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.237+0000 7fd63ba0d640 1 -- 172.21.15.17:0/1449192888 wait complete. 2024-04-17T02:22:20.251 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-17T02:22:20.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.362+0000 7f53d9b56640 1 Processor -- start 2024-04-17T02:22:20.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.362+0000 7f53d9b56640 1 -- start start 2024-04-17T02:22:20.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.363+0000 7f53d9b56640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f53d414e960 0x7f53d4150d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:20.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.363+0000 7f53d9b56640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53d40a7f00 con 0x7f53d40ab3b0 2024-04-17T02:22:20.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.363+0000 7f53d9b56640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53d40abd20 con 0x7f53d40a9560 2024-04-17T02:22:20.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.363+0000 7f53d9b56640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f53d40ac000 con 0x7f53d414e960 2024-04-17T02:22:20.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.363+0000 7f53d3fff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f53d414e960 0x7f53d4150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:20.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.363+0000 7f53d37fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f53d40ab3b0 0x7f53d40ac7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53850/0 (socket says 172.21.15.17:53850) 2024-04-17T02:22:20.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.363+0000 7f53d37fe640 1 -- 172.21.15.17:0/3636089952 learned_addr learned my addr 172.21.15.17:0/3636089952 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:22:20.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.363+0000 7f53d2ffd640 1 -- 172.21.15.17:0/3636089952 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2961333681 0 0) 0x7f53d40a7f00 con 0x7f53d40ab3b0 2024-04-17T02:22:20.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.363+0000 7f53d3fff640 1 -- 172.21.15.17:0/3636089952 >> v1:172.21.15.122:6789/0 conn(0x7f53d40a9560 legacy=0x7f53d4145730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:20.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.363+0000 7f53d3fff640 1 -- 172.21.15.17:0/3636089952 >> v1:172.21.15.17:6789/0 conn(0x7f53d40ab3b0 legacy=0x7f53d40ac7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:20.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.363+0000 7f53d3fff640 1 -- 172.21.15.17:0/3636089952 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d40a7960 con 0x7f53d414e960 2024-04-17T02:22:20.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.364+0000 7f53d3fff640 1 --2- 172.21.15.17:0/3636089952 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f53d414e960 0x7f53d4150d50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f53d40a7b90 tx=0x7f53cc02be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e8dcdb5c542ae23 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:20.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.364+0000 7f53d2ffd640 1 -- 172.21.15.17:0/3636089952 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53cc039070 con 0x7f53d414e960 2024-04-17T02:22:20.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.364+0000 7f53d2ffd640 1 -- 172.21.15.17:0/3636089952 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53cc02cc20 con 0x7f53d414e960 2024-04-17T02:22:20.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.364+0000 7f53d2ffd640 1 -- 172.21.15.17:0/3636089952 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53cc034440 con 0x7f53d414e960 2024-04-17T02:22:20.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.364+0000 7f53d9b56640 1 -- 172.21.15.17:0/3636089952 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f53d414e960 msgr2=0x7f53d4150d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:20.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.364+0000 7f53d9b56640 1 --2- 172.21.15.17:0/3636089952 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f53d414e960 0x7f53d4150d50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f53d40a7b90 tx=0x7f53cc02be70 comp rx=0 tx=0).stop 2024-04-17T02:22:20.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.365+0000 7f53d9b56640 1 -- 172.21.15.17:0/3636089952 shutdown_connections 2024-04-17T02:22:20.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.365+0000 7f53d9b56640 1 --2- 172.21.15.17:0/3636089952 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f53d414e960 0x7f53d4150d50 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:20.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.365+0000 7f53d9b56640 1 -- 172.21.15.17:0/3636089952 >> 172.21.15.17:0/3636089952 conn(0x7f53d40a9b60 msgr2=0x7f53d40a9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:20.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.365+0000 7f53d9b56640 1 -- 172.21.15.17:0/3636089952 shutdown_connections 2024-04-17T02:22:20.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.365+0000 7f53d9b56640 1 -- 172.21.15.17:0/3636089952 wait complete. 2024-04-17T02:22:20.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.365+0000 7f53d9b56640 1 Processor -- start 2024-04-17T02:22:20.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.366+0000 7f53d9b56640 1 -- start start 2024-04-17T02:22:20.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.366+0000 7f53d9b56640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53d40a9560 0x7f53d41488a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:20.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.366+0000 7f53d9b56640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53d40ab3b0 0x7f53d41da320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:20.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.366+0000 7f53d9b56640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f53d414e960 0x7f53d414b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:20.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.366+0000 7f53d9b56640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f53d406b5b0 con 0x7f53d40a9560 2024-04-17T02:22:20.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.366+0000 7f53d9b56640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f53d40ab7d0 con 0x7f53d40ab3b0 2024-04-17T02:22:20.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.366+0000 7f53d9b56640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f53d41dabe0 con 0x7f53d414e960 2024-04-17T02:22:20.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.366+0000 7f53d37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53d40a9560 0x7f53d41488a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:20.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.366+0000 7f53d3fff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f53d414e960 0x7f53d414b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:20.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.366+0000 7f53d3fff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f53d414e960 0x7f53d414b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:35260/0 (socket says 172.21.15.17:35260) 2024-04-17T02:22:20.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.366+0000 7f53d3fff640 1 -- 172.21.15.17:0/2826045834 learned_addr learned my addr 172.21.15.17:0/2826045834 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:20.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.366+0000 7f53d37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53d40a9560 0x7f53d41488a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51574/0 (socket says 172.21.15.17:51574) 2024-04-17T02:22:20.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.366+0000 7f53cbfff640 1 --2- 172.21.15.17:0/2826045834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53d40ab3b0 0x7f53d41da320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:20.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.366+0000 7f53d3fff640 1 -- 172.21.15.17:0/2826045834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53d40ab3b0 msgr2=0x7f53d41da320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:20.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.366+0000 7f53d3fff640 1 --2- 172.21.15.17:0/2826045834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53d40ab3b0 0x7f53d41da320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:20.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.366+0000 7f53d3fff640 1 -- 172.21.15.17:0/2826045834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53d40a9560 msgr2=0x7f53d41488a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:20.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.366+0000 7f53d3fff640 1 --2- 172.21.15.17:0/2826045834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53d40a9560 0x7f53d41488a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:20.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.366+0000 7f53d3fff640 1 -- 172.21.15.17:0/2826045834 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d41daea0 con 0x7f53d414e960 2024-04-17T02:22:20.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.366+0000 7f53d37fe640 1 --2- 172.21.15.17:0/2826045834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53d40a9560 0x7f53d41488a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:20.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.367+0000 7f53d3fff640 1 --2- 172.21.15.17:0/2826045834 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f53d414e960 0x7f53d414b4a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f53cc009ee0 tx=0x7f53cc004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:20.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.367+0000 7f53d0ff9640 1 -- 172.21.15.17:0/2826045834 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53cc039050 con 0x7f53d414e960 2024-04-17T02:22:20.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.367+0000 7f53d0ff9640 1 -- 172.21.15.17:0/2826045834 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53cc045070 con 0x7f53d414e960 2024-04-17T02:22:20.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.367+0000 7f53d0ff9640 1 -- 172.21.15.17:0/2826045834 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53cc03e830 con 0x7f53d414e960 2024-04-17T02:22:20.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.367+0000 7f53d9b56640 1 -- 172.21.15.17:0/2826045834 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53d41da860 con 0x7f53d414e960 2024-04-17T02:22:20.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.367+0000 7f53d9b56640 1 -- 172.21.15.17:0/2826045834 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f53d414bbc0 con 0x7f53d414e960 2024-04-17T02:22:20.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.368+0000 7f53d9b56640 1 -- 172.21.15.17:0/2826045834 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53d40687f0 con 0x7f53d414e960 2024-04-17T02:22:20.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.369+0000 7f53d0ff9640 1 -- 172.21.15.17:0/2826045834 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f53cc03e9d0 con 0x7f53d414e960 2024-04-17T02:22:20.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.369+0000 7f53d0ff9640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:20.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.369+0000 7f53d0ff9640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:20.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.369+0000 7f53d0ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:20.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.369+0000 7f53d0ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:20.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.369+0000 7f53d0ff9640 1 --2- 172.21.15.17:0/2826045834 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f53b409f480 0x7f53b40a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:20.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.369+0000 7f53d37fe640 1 --2- 172.21.15.17:0/2826045834 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f53b409f480 0x7f53b40a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:20.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.370+0000 7f53d0ff9640 1 -- 172.21.15.17:0/2826045834 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 3852+0+0 (secure 0 0 0) 0x7f53cc0ebfe0 con 0x7f53d414e960 2024-04-17T02:22:20.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.370+0000 7f53d37fe640 1 --2- 172.21.15.17:0/2826045834 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f53b409f480 0x7f53b40a1940 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f53c4000f60 tx=0x7f53c4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:20.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.374+0000 7f53d0ff9640 1 -- 172.21.15.17:0/2826045834 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f53cc0bb340 con 0x7f53d414e960 2024-04-17T02:22:20.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:20.554+0000 7f53d9b56640 1 -- 172.21.15.17:0/2826045834 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f53d406c250 con 0x7f53d414e960 2024-04-17T02:22:21.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.243+0000 7f53d0ff9640 1 -- 172.21.15.17:0/2826045834 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) ==== 170+0+0 (secure 0 0 0) 0x7f53cc0bac40 con 0x7f53d414e960 2024-04-17T02:22:21.245 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2024-04-17T02:22:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.247+0000 7f53d9b56640 10 mgrc shutdown 2024-04-17T02:22:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.247+0000 7f53d9b56640 1 -- 172.21.15.17:0/2826045834 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f53b409f480 msgr2=0x7f53b40a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.247+0000 7f53d9b56640 1 --2- 172.21.15.17:0/2826045834 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f53b409f480 0x7f53b40a1940 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f53c4000f60 tx=0x7f53c4009040 comp rx=0 tx=0).stop 2024-04-17T02:22:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.247+0000 7f53d9b56640 1 -- 172.21.15.17:0/2826045834 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f53d414e960 msgr2=0x7f53d414b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.247+0000 7f53d9b56640 1 --2- 172.21.15.17:0/2826045834 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f53d414e960 0x7f53d414b4a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f53cc009ee0 tx=0x7f53cc004a40 comp rx=0 tx=0).stop 2024-04-17T02:22:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.248+0000 7f53d9b56640 1 -- 172.21.15.17:0/2826045834 shutdown_connections 2024-04-17T02:22:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.248+0000 7f53d9b56640 1 --2- 172.21.15.17:0/2826045834 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f53b409f480 0x7f53b40a1940 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.248+0000 7f53d9b56640 1 --2- 172.21.15.17:0/2826045834 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f53d414e960 0x7f53d414b4a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.248+0000 7f53d9b56640 1 --2- 172.21.15.17:0/2826045834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53d40ab3b0 0x7f53d41da320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.248+0000 7f53d9b56640 1 --2- 172.21.15.17:0/2826045834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53d40a9560 0x7f53d41488a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.248+0000 7f53d9b56640 1 -- 172.21.15.17:0/2826045834 >> 172.21.15.17:0/2826045834 conn(0x7f53d40a9b60 msgr2=0x7f53d40bb240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.248+0000 7f53d9b56640 1 -- 172.21.15.17:0/2826045834 shutdown_connections 2024-04-17T02:22:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.248+0000 7f53d9b56640 1 -- 172.21.15.17:0/2826045834 wait complete. 2024-04-17T02:22:21.266 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-17T02:22:21.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.377+0000 7f0811014640 1 Processor -- start 2024-04-17T02:22:21.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.377+0000 7f0811014640 1 -- start start 2024-04-17T02:22:21.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.378+0000 7f0811014640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f080c0a84d0 0x7f080c0aa120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:21.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.378+0000 7f0811014640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f080c0a59a0 con 0x7f080c0aa940 2024-04-17T02:22:21.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.378+0000 7f0811014640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f080c148c10 con 0x7f080c06f600 2024-04-17T02:22:21.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.378+0000 7f0811014640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f080c0a88b0 con 0x7f080c0a84d0 2024-04-17T02:22:21.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.378+0000 7f080b59e640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f080c0aa940 0x7f080c14f880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39806/0 (socket says 172.21.15.17:39806) 2024-04-17T02:22:21.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.378+0000 7f080b59e640 1 -- 172.21.15.17:0/480909753 learned_addr learned my addr 172.21.15.17:0/480909753 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:22:21.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.378+0000 7f080ad9d640 1 --2- 172.21.15.17:0/480909753 >> v2:172.21.15.122:3300/0 conn(0x7f080c0a84d0 0x7f080c0aa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:21.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.379+0000 7f080a59c640 1 -- 172.21.15.17:0/480909753 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2567988972 0 0) 0x7f0804001490 con 0x7f080c0aa940 2024-04-17T02:22:21.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.379+0000 7f080a59c640 1 -- 172.21.15.17:0/480909753 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07f8003520 con 0x7f080c0aa940 2024-04-17T02:22:21.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.379+0000 7f080a59c640 1 -- 172.21.15.17:0/480909753 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2407747792 0 0) 0x7f07f8003520 con 0x7f080c0aa940 2024-04-17T02:22:21.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.379+0000 7f080a59c640 1 -- 172.21.15.17:0/480909753 >> v2:172.21.15.122:3300/0 conn(0x7f080c0a84d0 msgr2=0x7f080c0aa120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:21.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.379+0000 7f080a59c640 1 --2- 172.21.15.17:0/480909753 >> v2:172.21.15.122:3300/0 conn(0x7f080c0a84d0 0x7f080c0aa120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:21.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.379+0000 7f080a59c640 1 -- 172.21.15.17:0/480909753 >> v1:172.21.15.122:6789/0 conn(0x7f080c06f600 legacy=0x7f080c144710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:21.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.379+0000 7f080a59c640 1 -- 172.21.15.17:0/480909753 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f080c148ed0 con 0x7f080c0aa940 2024-04-17T02:22:21.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.379+0000 7f080a59c640 1 -- 172.21.15.17:0/480909753 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1752030744 0 0) 0x7f0804001bc0 con 0x7f080c0aa940 2024-04-17T02:22:21.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.379+0000 7f080a59c640 1 -- 172.21.15.17:0/480909753 >> v1:172.21.15.17:6789/0 conn(0x7f080c0aa940 legacy=0x7f080c14f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:21.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.379+0000 7f080a59c640 1 --2- 172.21.15.17:0/480909753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07f80039b0 0x7f07f8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:21.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.379+0000 7f080a59c640 1 --2- 172.21.15.17:0/480909753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07f8004800 0x7f07f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:21.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.379+0000 7f080a59c640 1 --2- 172.21.15.17:0/480909753 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f07f80051c0 0x7f07f800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:21.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.379+0000 7f080a59c640 1 -- 172.21.15.17:0/480909753 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f080c0a88b0 con 0x7f07f80039b0 2024-04-17T02:22:21.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.379+0000 7f080a59c640 1 -- 172.21.15.17:0/480909753 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f07f800c110 con 0x7f07f8004800 2024-04-17T02:22:21.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.379+0000 7f080a59c640 1 -- 172.21.15.17:0/480909753 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f07f800c310 con 0x7f07f80051c0 2024-04-17T02:22:21.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.379+0000 7f080ad9d640 1 --2- 172.21.15.17:0/480909753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07f80039b0 0x7f07f8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:21.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.379+0000 7f080b59e640 1 --2- 172.21.15.17:0/480909753 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f07f80051c0 0x7f07f800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:21.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.379+0000 7f0803fff640 1 --2- 172.21.15.17:0/480909753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07f8004800 0x7f07f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:21.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.379+0000 7f080ad9d640 1 -- 172.21.15.17:0/480909753 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f07f80051c0 msgr2=0x7f07f800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:21.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.379+0000 7f080ad9d640 1 --2- 172.21.15.17:0/480909753 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f07f80051c0 0x7f07f800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:21.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.379+0000 7f080ad9d640 1 -- 172.21.15.17:0/480909753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07f8004800 msgr2=0x7f07f8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:21.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.379+0000 7f080ad9d640 1 --2- 172.21.15.17:0/480909753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07f8004800 0x7f07f8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:21.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.379+0000 7f080ad9d640 1 -- 172.21.15.17:0/480909753 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07f8003520 con 0x7f07f80039b0 2024-04-17T02:22:21.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.379+0000 7f080b59e640 1 --2- 172.21.15.17:0/480909753 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f07f80051c0 0x7f07f800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:21.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.379+0000 7f080b59e640 1 -- 172.21.15.17:0/480909753 reap_dead start 2024-04-17T02:22:21.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.380+0000 7f080ad9d640 1 --2- 172.21.15.17:0/480909753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07f80039b0 0x7f07f8003d90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f07fc009ac0 tx=0x7f07f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=677a4ea97f9d2be2 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:21.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.380+0000 7f080a59c640 1 -- 172.21.15.17:0/480909753 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07fc039070 con 0x7f07f80039b0 2024-04-17T02:22:21.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.380+0000 7f080a59c640 1 -- 172.21.15.17:0/480909753 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07fc02c6b0 con 0x7f07f80039b0 2024-04-17T02:22:21.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.380+0000 7f080a59c640 1 -- 172.21.15.17:0/480909753 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07fc009690 con 0x7f07f80039b0 2024-04-17T02:22:21.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.381+0000 7f0811014640 1 -- 172.21.15.17:0/480909753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07f80039b0 msgr2=0x7f07f8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:21.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.381+0000 7f0811014640 1 --2- 172.21.15.17:0/480909753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07f80039b0 0x7f07f8003d90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f07fc009ac0 tx=0x7f07f8005830 comp rx=0 tx=0).stop 2024-04-17T02:22:21.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.381+0000 7f0811014640 1 -- 172.21.15.17:0/480909753 shutdown_connections 2024-04-17T02:22:21.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.381+0000 7f0811014640 1 --2- 172.21.15.17:0/480909753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07f80039b0 0x7f07f8003d90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:21.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.381+0000 7f0811014640 1 -- 172.21.15.17:0/480909753 >> 172.21.15.17:0/480909753 conn(0x7f080c0746a0 msgr2=0x7f080c0a7ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:21.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.381+0000 7f0811014640 1 -- 172.21.15.17:0/480909753 shutdown_connections 2024-04-17T02:22:21.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.381+0000 7f0811014640 1 -- 172.21.15.17:0/480909753 wait complete. 2024-04-17T02:22:21.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.382+0000 7f0811014640 1 Processor -- start 2024-04-17T02:22:21.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.382+0000 7f0811014640 1 -- start start 2024-04-17T02:22:21.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.382+0000 7f0811014640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f07f80039b0 0x7f080c06e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:21.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.382+0000 7f0811014640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f080c139210 0x7f080c09dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:21.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.383+0000 7f0811014640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f080c09f020 0x7f080c0b5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:21.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.383+0000 7f0811014640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f080c0aa2a0 con 0x7f080c09f020 2024-04-17T02:22:21.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.383+0000 7f0811014640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f080c0aa120 con 0x7f080c139210 2024-04-17T02:22:21.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.383+0000 7f0811014640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f080c0aa420 con 0x7f07f80039b0 2024-04-17T02:22:21.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.383+0000 7f080ad9d640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f07f80039b0 0x7f080c06e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:21.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.383+0000 7f080ad9d640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f07f80039b0 0x7f080c06e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:57910/0 (socket says 172.21.15.17:57910) 2024-04-17T02:22:21.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.383+0000 7f080ad9d640 1 -- 172.21.15.17:0/585001299 learned_addr learned my addr 172.21.15.17:0/585001299 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:21.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.383+0000 7f080b59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f080c09f020 0x7f080c0b5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:21.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.383+0000 7f0803fff640 1 --2- 172.21.15.17:0/585001299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f080c139210 0x7f080c09dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:21.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.383+0000 7f080ad9d640 1 -- 172.21.15.17:0/585001299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f080c139210 msgr2=0x7f080c09dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:21.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.383+0000 7f080ad9d640 1 --2- 172.21.15.17:0/585001299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f080c139210 0x7f080c09dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:21.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.383+0000 7f080ad9d640 1 -- 172.21.15.17:0/585001299 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f080c09f020 msgr2=0x7f080c0b5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:21.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.383+0000 7f080ad9d640 1 --2- 172.21.15.17:0/585001299 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f080c09f020 0x7f080c0b5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:21.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.383+0000 7f080ad9d640 1 -- 172.21.15.17:0/585001299 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f080c09f770 con 0x7f07f80039b0 2024-04-17T02:22:21.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.383+0000 7f080b59e640 1 --2- 172.21.15.17:0/585001299 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f080c09f020 0x7f080c0b5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:21.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.383+0000 7f0803fff640 1 --2- 172.21.15.17:0/585001299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f080c139210 0x7f080c09dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T02:22:21.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.383+0000 7f080ad9d640 1 --2- 172.21.15.17:0/585001299 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f07f80039b0 0x7f080c06e730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f07fc000c00 tx=0x7f07fc004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:21.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.383+0000 7f08037fe640 1 -- 172.21.15.17:0/585001299 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07fc042020 con 0x7f07f80039b0 2024-04-17T02:22:21.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.383+0000 7f08037fe640 1 -- 172.21.15.17:0/585001299 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07fc03a040 con 0x7f07f80039b0 2024-04-17T02:22:21.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.383+0000 7f0811014640 1 -- 172.21.15.17:0/585001299 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f080c09f4a0 con 0x7f07f80039b0 2024-04-17T02:22:21.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.383+0000 7f08037fe640 1 -- 172.21.15.17:0/585001299 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07fc039070 con 0x7f07f80039b0 2024-04-17T02:22:21.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.383+0000 7f0811014640 1 -- 172.21.15.17:0/585001299 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f080c0a4d30 con 0x7f07f80039b0 2024-04-17T02:22:21.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.384+0000 7f0811014640 1 -- 172.21.15.17:0/585001299 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f080c148370 con 0x7f07f80039b0 2024-04-17T02:22:21.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.385+0000 7f08037fe640 1 -- 172.21.15.17:0/585001299 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f07fc045020 con 0x7f07f80039b0 2024-04-17T02:22:21.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.386+0000 7f08037fe640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:21.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.386+0000 7f08037fe640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:21.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.386+0000 7f08037fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:21.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.386+0000 7f08037fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:21.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.386+0000 7f08037fe640 1 --2- 172.21.15.17:0/585001299 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f07ec09f400 0x7f07ec0a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:21.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.387+0000 7f0803fff640 1 --2- 172.21.15.17:0/585001299 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f07ec09f400 0x7f07ec0a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:21.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.387+0000 7f08037fe640 1 -- 172.21.15.17:0/585001299 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(18..18 src has 1..18) ==== 4234+0+0 (secure 0 0 0) 0x7f07fc0ea780 con 0x7f07f80039b0 2024-04-17T02:22:21.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.387+0000 7f0803fff640 1 --2- 172.21.15.17:0/585001299 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f07ec09f400 0x7f07ec0a18c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f080c0a4480 tx=0x7f07f4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:21.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.391+0000 7f08037fe640 1 -- 172.21.15.17:0/585001299 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f080c148370 con 0x7f07f80039b0 2024-04-17T02:22:21.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:21.609+0000 7f0811014640 1 -- 172.21.15.17:0/585001299 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f080c067f80 con 0x7f07f80039b0 2024-04-17T02:22:22.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.244+0000 7f08037fe640 1 -- 172.21.15.17:0/585001299 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) ==== 172+0+0 (secure 0 0 0) 0x7f07fc04c070 con 0x7f07f80039b0 2024-04-17T02:22:22.246 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 3 and data pool 4 2024-04-17T02:22:22.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.249+0000 7f0811014640 10 mgrc shutdown 2024-04-17T02:22:22.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.249+0000 7f0811014640 1 -- 172.21.15.17:0/585001299 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f07ec09f400 msgr2=0x7f07ec0a18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:22.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.249+0000 7f0811014640 1 --2- 172.21.15.17:0/585001299 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f07ec09f400 0x7f07ec0a18c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f080c0a4480 tx=0x7f07f4009040 comp rx=0 tx=0).stop 2024-04-17T02:22:22.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.249+0000 7f0811014640 1 -- 172.21.15.17:0/585001299 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f07f80039b0 msgr2=0x7f080c06e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:22.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.249+0000 7f0811014640 1 --2- 172.21.15.17:0/585001299 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f07f80039b0 0x7f080c06e730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f07fc000c00 tx=0x7f07fc004730 comp rx=0 tx=0).stop 2024-04-17T02:22:22.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.250+0000 7f0811014640 1 -- 172.21.15.17:0/585001299 shutdown_connections 2024-04-17T02:22:22.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.250+0000 7f0811014640 1 --2- 172.21.15.17:0/585001299 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f07ec09f400 0x7f07ec0a18c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:22.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.250+0000 7f0811014640 1 --2- 172.21.15.17:0/585001299 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f080c09f020 0x7f080c0b5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:22.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.250+0000 7f0811014640 1 --2- 172.21.15.17:0/585001299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f080c139210 0x7f080c09dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:22.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.250+0000 7f0811014640 1 --2- 172.21.15.17:0/585001299 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f07f80039b0 0x7f080c06e730 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:22.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.250+0000 7f0811014640 1 -- 172.21.15.17:0/585001299 >> 172.21.15.17:0/585001299 conn(0x7f080c0746a0 msgr2=0x7f080c0a6060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:22.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.252+0000 7f0811014640 1 -- 172.21.15.17:0/585001299 shutdown_connections 2024-04-17T02:22:22.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.252+0000 7f0811014640 1 -- 172.21.15.17:0/585001299 wait complete. 2024-04-17T02:22:22.271 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T02:22:22.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.379+0000 7f734b32a640 1 Processor -- start 2024-04-17T02:22:22.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.379+0000 7f734b32a640 1 -- start start 2024-04-17T02:22:22.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.379+0000 7f734b32a640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f73440a9c00 0x7f73440aa090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:22.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.379+0000 7f734b32a640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7344148870 con 0x7f734413b540 2024-04-17T02:22:22.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.379+0000 7f734b32a640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f734413bc90 con 0x7f73440b8e30 2024-04-17T02:22:22.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.379+0000 7f734b32a640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f73440b9210 con 0x7f73440a9c00 2024-04-17T02:22:22.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.380+0000 7f73488c5640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f734413b540 0x7f7344148f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39820/0 (socket says 172.21.15.17:39820) 2024-04-17T02:22:22.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.380+0000 7f73488c5640 1 -- 172.21.15.17:0/550192591 learned_addr learned my addr 172.21.15.17:0/550192591 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:22:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.380+0000 7f73498c7640 1 --2- 172.21.15.17:0/550192591 >> v2:172.21.15.122:3300/0 conn(0x7f73440a9c00 0x7f73440aa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.380+0000 7f733bfff640 1 -- 172.21.15.17:0/550192591 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4192510348 0 0) 0x7f7344148870 con 0x7f734413b540 2024-04-17T02:22:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.380+0000 7f733bfff640 1 -- 172.21.15.17:0/550192591 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7330003520 con 0x7f734413b540 2024-04-17T02:22:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.380+0000 7f733bfff640 1 -- 172.21.15.17:0/550192591 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4230476127 0 0) 0x7f7330003520 con 0x7f734413b540 2024-04-17T02:22:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.380+0000 7f73498c7640 1 -- 172.21.15.17:0/550192591 >> v1:172.21.15.122:6789/0 conn(0x7f73440b8e30 legacy=0x7f73440aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.380+0000 7f73498c7640 1 -- 172.21.15.17:0/550192591 >> v1:172.21.15.17:6789/0 conn(0x7f734413b540 legacy=0x7f7344148f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.380+0000 7f73498c7640 1 -- 172.21.15.17:0/550192591 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7344152a50 con 0x7f73440a9c00 2024-04-17T02:22:22.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.381+0000 7f73498c7640 1 --2- 172.21.15.17:0/550192591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f73440a9c00 0x7f73440aa090 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f733c009d90 tx=0x7f733c02bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe04e8a6f07c8bf8 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:22.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.381+0000 7f733bfff640 1 -- 172.21.15.17:0/550192591 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733c039070 con 0x7f73440a9c00 2024-04-17T02:22:22.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.381+0000 7f733bfff640 1 -- 172.21.15.17:0/550192591 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f733c02c8b0 con 0x7f73440a9c00 2024-04-17T02:22:22.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.381+0000 7f733bfff640 1 -- 172.21.15.17:0/550192591 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73340017f0 con 0x7f73440a9c00 2024-04-17T02:22:22.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.382+0000 7f734b32a640 1 -- 172.21.15.17:0/550192591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f73440a9c00 msgr2=0x7f73440aa090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:22.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.382+0000 7f734b32a640 1 --2- 172.21.15.17:0/550192591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f73440a9c00 0x7f73440aa090 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f733c009d90 tx=0x7f733c02bd80 comp rx=0 tx=0).stop 2024-04-17T02:22:22.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.382+0000 7f734b32a640 1 -- 172.21.15.17:0/550192591 shutdown_connections 2024-04-17T02:22:22.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.382+0000 7f734b32a640 1 --2- 172.21.15.17:0/550192591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f73440a9c00 0x7f73440aa090 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:22.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.382+0000 7f734b32a640 1 -- 172.21.15.17:0/550192591 >> 172.21.15.17:0/550192591 conn(0x7f73440741a0 msgr2=0x7f73440745b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:22.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.382+0000 7f734b32a640 1 -- 172.21.15.17:0/550192591 shutdown_connections 2024-04-17T02:22:22.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.382+0000 7f734b32a640 1 -- 172.21.15.17:0/550192591 wait complete. 2024-04-17T02:22:22.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.383+0000 7f734b32a640 1 Processor -- start 2024-04-17T02:22:22.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.383+0000 7f734b32a640 1 -- start start 2024-04-17T02:22:22.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.383+0000 7f734b32a640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f73440a9c00 0x7f73441316b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:22.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.383+0000 7f734b32a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73440b8e30 0x7f7344132e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:22.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.383+0000 7f734b32a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f734413b540 0x7f73440a3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:22.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.383+0000 7f734b32a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7344150c40 con 0x7f73440b8e30 2024-04-17T02:22:22.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.383+0000 7f734b32a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7344149660 con 0x7f734413b540 2024-04-17T02:22:22.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.383+0000 7f734b32a640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f7344150dc0 con 0x7f73440a9c00 2024-04-17T02:22:22.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.383+0000 7f73488c5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73440b8e30 0x7f7344132e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:22.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.383+0000 7f73490c6640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f73440a9c00 0x7f73441316b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:22.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.383+0000 7f73488c5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73440b8e30 0x7f7344132e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44474/0 (socket says 172.21.15.17:44474) 2024-04-17T02:22:22.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.383+0000 7f73490c6640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f73440a9c00 0x7f73441316b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:57922/0 (socket says 172.21.15.17:57922) 2024-04-17T02:22:22.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.383+0000 7f73488c5640 1 -- 172.21.15.17:0/1473558285 learned_addr learned my addr 172.21.15.17:0/1473558285 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:22.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.383+0000 7f73498c7640 1 --2- 172.21.15.17:0/1473558285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f734413b540 0x7f73440a3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:22.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.384+0000 7f73490c6640 1 -- 172.21.15.17:0/1473558285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f734413b540 msgr2=0x7f73440a3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:22.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.384+0000 7f73490c6640 1 --2- 172.21.15.17:0/1473558285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f734413b540 0x7f73440a3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:22.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.384+0000 7f73490c6640 1 -- 172.21.15.17:0/1473558285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73440b8e30 msgr2=0x7f7344132e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:22.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.384+0000 7f73490c6640 1 --2- 172.21.15.17:0/1473558285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73440b8e30 0x7f7344132e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:22.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.384+0000 7f73490c6640 1 -- 172.21.15.17:0/1473558285 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73440a4480 con 0x7f73440a9c00 2024-04-17T02:22:22.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.384+0000 7f73488c5640 1 --2- 172.21.15.17:0/1473558285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73440b8e30 0x7f7344132e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:22.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.384+0000 7f73490c6640 1 --2- 172.21.15.17:0/1473558285 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f73440a9c00 0x7f73441316b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f734000c390 tx=0x7f734000c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:22.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.384+0000 7f7339ffb640 1 -- 172.21.15.17:0/1473558285 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7340017070 con 0x7f73440a9c00 2024-04-17T02:22:22.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.384+0000 7f7339ffb640 1 -- 172.21.15.17:0/1473558285 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73400052d0 con 0x7f73440a9c00 2024-04-17T02:22:22.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.384+0000 7f734b32a640 1 -- 172.21.15.17:0/1473558285 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73440a4740 con 0x7f73440a9c00 2024-04-17T02:22:22.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.384+0000 7f7339ffb640 1 -- 172.21.15.17:0/1473558285 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7340003830 con 0x7f73440a9c00 2024-04-17T02:22:22.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.384+0000 7f734b32a640 1 -- 172.21.15.17:0/1473558285 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f734413f430 con 0x7f73440a9c00 2024-04-17T02:22:22.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.385+0000 7f734b32a640 1 -- 172.21.15.17:0/1473558285 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f734413f750 con 0x7f73440a9c00 2024-04-17T02:22:22.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.386+0000 7f7339ffb640 1 -- 172.21.15.17:0/1473558285 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f734001a070 con 0x7f73440a9c00 2024-04-17T02:22:22.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.386+0000 7f7339ffb640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:22.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.387+0000 7f7339ffb640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:22.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.387+0000 7f7339ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:22.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.387+0000 7f7339ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:22.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.387+0000 7f7339ffb640 1 --2- 172.21.15.17:0/1473558285 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f732809f480 0x7f73280a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:22.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.387+0000 7f73488c5640 1 --2- 172.21.15.17:0/1473558285 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f732809f480 0x7f73280a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:22.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.387+0000 7f7339ffb640 1 -- 172.21.15.17:0/1473558285 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(19..19 src has 1..19) ==== 4334+0+0 (secure 0 0 0) 0x7f73400c8790 con 0x7f73440a9c00 2024-04-17T02:22:22.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.387+0000 7f73488c5640 1 --2- 172.21.15.17:0/1473558285 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f732809f480 0x7f73280a1940 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7334001960 tx=0x7f7334009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:22.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.391+0000 7f7339ffb640 1 -- 172.21.15.17:0/1473558285 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f7340097100 con 0x7f73440a9c00 2024-04-17T02:22:22.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.576+0000 7f734b32a640 1 -- 172.21.15.17:0/1473558285 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f73440687f0 con 0x7f73440a9c00 2024-04-17T02:22:22.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.577+0000 7f7339ffb640 1 -- 172.21.15.17:0/1473558285 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+13574 (secure 0 0 0) 0x7f734009b1a0 con 0x7f73440a9c00 2024-04-17T02:22:22.578 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:22:22.578 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":19,"fsid":"7cbfae20-b10d-41da-92b7-cbd5c1632e23","created":"2024-04-17T02:22:00.246446+0000","modified":"2024-04-17T02:22:21.611415+0000","last_up_change":"2024-04-17T02:22:09.077928+0000","last_in_change":"2024-04-17T02:22:01.415384+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T02:22:10.533377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-17T02:22:15.947495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-17T02:22:20.016616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-17T02:22:20.573938+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2973665c-6c5e-4688-bffe-72d3bdcf467f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6801","nonce":1828284343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6803","nonce":1828284343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6807","nonce":1828284343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6805","nonce":1828284343}]},"public_addr":"172.21.15.17:6801/1828284343","cluster_addr":"172.21.15.17:6803/1828284343","heartbeat_back_addr":"172.21.15.17:6807/1828284343","heartbeat_front_addr":"172.21.15.17:6805/1828284343","state":["exists","up"]},{"osd":1,"uuid":"a59a034d-19b4-47e8-8ca5-538597b4af1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6809","nonce":2064593011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6811","nonce":2064593011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6815","nonce":2064593011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6813","nonce":2064593011}]},"public_addr":"172.21.15.122:6809/2064593011","cluster_addr":"172.21.15.122:6811/2064593011","heartbeat_back_addr":"172.21.15.122:6815/2064593011","heartbeat_front_addr":"172.21.15.122:6813/2064593011","state":["exists","up"]},{"osd":2,"uuid":"070f4c5f-459f-46ff-b980-05b1ac50c951","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6817","nonce":929092547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6819","nonce":929092547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6823","nonce":929092547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6821","nonce":929092547}]},"public_addr":"172.21.15.122:6817/929092547","cluster_addr":"172.21.15.122:6819/929092547","heartbeat_back_addr":"172.21.15.122:6823/929092547","heartbeat_front_addr":"172.21.15.122:6821/929092547","state":["exists","up"]},{"osd":3,"uuid":"96216a49-a7b6-40eb-bc93-cc8c78a5270a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6801","nonce":204132523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6803","nonce":204132523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6807","nonce":204132523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6805","nonce":204132523}]},"public_addr":"172.21.15.122:6801/204132523","cluster_addr":"172.21.15.122:6803/204132523","heartbeat_back_addr":"172.21.15.122:6807/204132523","heartbeat_front_addr":"172.21.15.122:6805/204132523","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.477173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.522791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.590625+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.480698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T02:22:22.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.579+0000 7f734b32a640 10 mgrc shutdown 2024-04-17T02:22:22.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.579+0000 7f734b32a640 1 -- 172.21.15.17:0/1473558285 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f732809f480 msgr2=0x7f73280a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:22.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.579+0000 7f734b32a640 1 --2- 172.21.15.17:0/1473558285 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f732809f480 0x7f73280a1940 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7334001960 tx=0x7f7334009040 comp rx=0 tx=0).stop 2024-04-17T02:22:22.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.579+0000 7f734b32a640 1 -- 172.21.15.17:0/1473558285 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f73440a9c00 msgr2=0x7f73441316b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:22.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.579+0000 7f734b32a640 1 --2- 172.21.15.17:0/1473558285 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f73440a9c00 0x7f73441316b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f734000c390 tx=0x7f734000c850 comp rx=0 tx=0).stop 2024-04-17T02:22:22.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.579+0000 7f734b32a640 1 -- 172.21.15.17:0/1473558285 shutdown_connections 2024-04-17T02:22:22.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.579+0000 7f734b32a640 1 --2- 172.21.15.17:0/1473558285 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f732809f480 0x7f73280a1940 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:22.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.579+0000 7f734b32a640 1 --2- 172.21.15.17:0/1473558285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73440b8e30 0x7f7344132e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:22.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.579+0000 7f734b32a640 1 --2- 172.21.15.17:0/1473558285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f734413b540 0x7f73440a3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:22.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.579+0000 7f734b32a640 1 --2- 172.21.15.17:0/1473558285 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f73440a9c00 0x7f73441316b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:22.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.579+0000 7f734b32a640 1 -- 172.21.15.17:0/1473558285 >> 172.21.15.17:0/1473558285 conn(0x7f73440741a0 msgr2=0x7f7344068ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:22.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.579+0000 7f734b32a640 1 -- 172.21.15.17:0/1473558285 shutdown_connections 2024-04-17T02:22:22.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.579+0000 7f734b32a640 1 -- 172.21.15.17:0/1473558285 wait complete. 2024-04-17T02:22:22.595 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T02:22:22.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.697+0000 7f0874a64640 1 Processor -- start 2024-04-17T02:22:22.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.697+0000 7f0874a64640 1 -- start start 2024-04-17T02:22:22.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.698+0000 7f0874a64640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f08700ab5b0 0x7f08700ac680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:22.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.698+0000 7f0874a64640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08700acea0 con 0x7f08700bb460 2024-04-17T02:22:22.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.698+0000 7f0874a64640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08700acbc0 con 0x7f0870142c90 2024-04-17T02:22:22.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.698+0000 7f0874a64640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f08700ab990 con 0x7f08700ab5b0 2024-04-17T02:22:22.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.698+0000 7f086e59c640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f08700ab5b0 0x7f08700ac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:22.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.698+0000 7f086dd9b640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f08700bb460 0x7f0870142580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39830/0 (socket says 172.21.15.17:39830) 2024-04-17T02:22:22.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.698+0000 7f086dd9b640 1 -- 172.21.15.17:0/2326698499 learned_addr learned my addr 172.21.15.17:0/2326698499 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:22:22.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.699+0000 7f086d59a640 1 -- 172.21.15.17:0/2326698499 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4029989695 0 0) 0x7f08700acea0 con 0x7f08700bb460 2024-04-17T02:22:22.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.699+0000 7f086e59c640 1 -- 172.21.15.17:0/2326698499 >> v1:172.21.15.122:6789/0 conn(0x7f0870142c90 legacy=0x7f087014fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:22.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.699+0000 7f086e59c640 1 -- 172.21.15.17:0/2326698499 >> v1:172.21.15.17:6789/0 conn(0x7f08700bb460 legacy=0x7f0870142580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:22.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.699+0000 7f086e59c640 1 -- 172.21.15.17:0/2326698499 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f087006dd30 con 0x7f08700ab5b0 2024-04-17T02:22:22.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.699+0000 7f086e59c640 1 --2- 172.21.15.17:0/2326698499 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f08700ab5b0 0x7f08700ac680 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f08600097d0 tx=0x7f086002b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d97bff29d16dafb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:22.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.700+0000 7f086d59a640 1 -- 172.21.15.17:0/2326698499 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0860035020 con 0x7f08700ab5b0 2024-04-17T02:22:22.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.700+0000 7f086d59a640 1 -- 172.21.15.17:0/2326698499 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0860031800 con 0x7f08700ab5b0 2024-04-17T02:22:22.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.700+0000 7f086d59a640 1 -- 172.21.15.17:0/2326698499 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0860031bd0 con 0x7f08700ab5b0 2024-04-17T02:22:22.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.700+0000 7f0874a64640 1 -- 172.21.15.17:0/2326698499 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f08700ab5b0 msgr2=0x7f08700ac680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:22.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.700+0000 7f0874a64640 1 --2- 172.21.15.17:0/2326698499 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f08700ab5b0 0x7f08700ac680 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f08600097d0 tx=0x7f086002b8a0 comp rx=0 tx=0).stop 2024-04-17T02:22:22.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.700+0000 7f0874a64640 1 -- 172.21.15.17:0/2326698499 shutdown_connections 2024-04-17T02:22:22.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.700+0000 7f0874a64640 1 --2- 172.21.15.17:0/2326698499 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f08700ab5b0 0x7f08700ac680 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:22.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.700+0000 7f0874a64640 1 -- 172.21.15.17:0/2326698499 >> 172.21.15.17:0/2326698499 conn(0x7f08700ba940 msgr2=0x7f08700bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:22.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.700+0000 7f0874a64640 1 -- 172.21.15.17:0/2326698499 shutdown_connections 2024-04-17T02:22:22.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.700+0000 7f0874a64640 1 -- 172.21.15.17:0/2326698499 wait complete. 2024-04-17T02:22:22.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.701+0000 7f0874a64640 1 Processor -- start 2024-04-17T02:22:22.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.701+0000 7f0874a64640 1 -- start start 2024-04-17T02:22:22.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.702+0000 7f0874a64640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f08700ab5b0 0x7f0870145d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:22.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.702+0000 7f0874a64640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08700bb460 0x7f087013cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:22.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.702+0000 7f0874a64640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0870142c90 0x7f08700a2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:22.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.702+0000 7f0874a64640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f08700a9700 con 0x7f0870142c90 2024-04-17T02:22:22.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.702+0000 7f0874a64640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f08700a9880 con 0x7f08700bb460 2024-04-17T02:22:22.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.702+0000 7f0874a64640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f08701511b0 con 0x7f08700ab5b0 2024-04-17T02:22:22.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.702+0000 7f086e59c640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f08700ab5b0 0x7f0870145d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:22.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.702+0000 7f086ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0870142c90 0x7f08700a2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:22.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.702+0000 7f086e59c640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f08700ab5b0 0x7f0870145d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:57938/0 (socket says 172.21.15.17:57938) 2024-04-17T02:22:22.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.702+0000 7f086e59c640 1 -- 172.21.15.17:0/926729340 learned_addr learned my addr 172.21.15.17:0/926729340 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:22.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.702+0000 7f086dd9b640 1 --2- 172.21.15.17:0/926729340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08700bb460 0x7f087013cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:22.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.702+0000 7f086e59c640 1 -- 172.21.15.17:0/926729340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08700bb460 msgr2=0x7f087013cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:22.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.702+0000 7f086e59c640 1 --2- 172.21.15.17:0/926729340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08700bb460 0x7f087013cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:22.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.702+0000 7f086e59c640 1 -- 172.21.15.17:0/926729340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0870142c90 msgr2=0x7f08700a2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:22.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.702+0000 7f086e59c640 1 --2- 172.21.15.17:0/926729340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0870142c90 0x7f08700a2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:22.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.702+0000 7f086e59c640 1 -- 172.21.15.17:0/926729340 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f087013efe0 con 0x7f08700ab5b0 2024-04-17T02:22:22.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.703+0000 7f086e59c640 1 --2- 172.21.15.17:0/926729340 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f08700ab5b0 0x7f0870145d70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f08600098f0 tx=0x7f08600046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:22.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.703+0000 7f085effd640 1 -- 172.21.15.17:0/926729340 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086003cd00 con 0x7f08700ab5b0 2024-04-17T02:22:22.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.703+0000 7f085effd640 1 -- 172.21.15.17:0/926729340 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0860004030 con 0x7f08700ab5b0 2024-04-17T02:22:22.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.703+0000 7f0874a64640 1 -- 172.21.15.17:0/926729340 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f087013c540 con 0x7f08700ab5b0 2024-04-17T02:22:22.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.703+0000 7f085effd640 1 -- 172.21.15.17:0/926729340 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0860004420 con 0x7f08700ab5b0 2024-04-17T02:22:22.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.703+0000 7f0874a64640 1 -- 172.21.15.17:0/926729340 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f08700b7870 con 0x7f08700ab5b0 2024-04-17T02:22:22.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.704+0000 7f0874a64640 1 -- 172.21.15.17:0/926729340 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f087013ed50 con 0x7f08700ab5b0 2024-04-17T02:22:22.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.705+0000 7f085effd640 1 -- 172.21.15.17:0/926729340 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f0860038020 con 0x7f08700ab5b0 2024-04-17T02:22:22.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.705+0000 7f085effd640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:22.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.705+0000 7f085effd640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:22.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.705+0000 7f085effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:22.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.705+0000 7f085effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:22.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.705+0000 7f085effd640 1 --2- 172.21.15.17:0/926729340 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f085009f480 0x7f08500a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:22.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.705+0000 7f086dd9b640 1 --2- 172.21.15.17:0/926729340 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f085009f480 0x7f08500a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:22.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.705+0000 7f085effd640 1 -- 172.21.15.17:0/926729340 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(19..19 src has 1..19) ==== 4334+0+0 (secure 0 0 0) 0x7f08600eb950 con 0x7f08700ab5b0 2024-04-17T02:22:22.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.706+0000 7f086dd9b640 1 --2- 172.21.15.17:0/926729340 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f085009f480 0x7f08500a1940 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0870068370 tx=0x7f0864007b70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:22.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.710+0000 7f085effd640 1 -- 172.21.15.17:0/926729340 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0860041070 con 0x7f08700ab5b0 2024-04-17T02:22:22.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.890+0000 7f0874a64640 1 -- 172.21.15.17:0/926729340 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f08700687f0 con 0x7f08700ab5b0 2024-04-17T02:22:22.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.891+0000 7f085effd640 1 -- 172.21.15.17:0/926729340 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+13574 (secure 0 0 0) 0x7f08600ba9b0 con 0x7f08700ab5b0 2024-04-17T02:22:22.892 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:22:22.892 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":19,"fsid":"7cbfae20-b10d-41da-92b7-cbd5c1632e23","created":"2024-04-17T02:22:00.246446+0000","modified":"2024-04-17T02:22:21.611415+0000","last_up_change":"2024-04-17T02:22:09.077928+0000","last_in_change":"2024-04-17T02:22:01.415384+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T02:22:10.533377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-17T02:22:15.947495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-17T02:22:20.016616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-17T02:22:20.573938+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2973665c-6c5e-4688-bffe-72d3bdcf467f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6801","nonce":1828284343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6803","nonce":1828284343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6807","nonce":1828284343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6805","nonce":1828284343}]},"public_addr":"172.21.15.17:6801/1828284343","cluster_addr":"172.21.15.17:6803/1828284343","heartbeat_back_addr":"172.21.15.17:6807/1828284343","heartbeat_front_addr":"172.21.15.17:6805/1828284343","state":["exists","up"]},{"osd":1,"uuid":"a59a034d-19b4-47e8-8ca5-538597b4af1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6809","nonce":2064593011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6811","nonce":2064593011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6815","nonce":2064593011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6813","nonce":2064593011}]},"public_addr":"172.21.15.122:6809/2064593011","cluster_addr":"172.21.15.122:6811/2064593011","heartbeat_back_addr":"172.21.15.122:6815/2064593011","heartbeat_front_addr":"172.21.15.122:6813/2064593011","state":["exists","up"]},{"osd":2,"uuid":"070f4c5f-459f-46ff-b980-05b1ac50c951","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6817","nonce":929092547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6819","nonce":929092547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6823","nonce":929092547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6821","nonce":929092547}]},"public_addr":"172.21.15.122:6817/929092547","cluster_addr":"172.21.15.122:6819/929092547","heartbeat_back_addr":"172.21.15.122:6823/929092547","heartbeat_front_addr":"172.21.15.122:6821/929092547","state":["exists","up"]},{"osd":3,"uuid":"96216a49-a7b6-40eb-bc93-cc8c78a5270a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6801","nonce":204132523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6803","nonce":204132523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6807","nonce":204132523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6805","nonce":204132523}]},"public_addr":"172.21.15.122:6801/204132523","cluster_addr":"172.21.15.122:6803/204132523","heartbeat_back_addr":"172.21.15.122:6807/204132523","heartbeat_front_addr":"172.21.15.122:6805/204132523","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.477173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.522791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.590625+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.480698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T02:22:22.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.893+0000 7f0874a64640 10 mgrc shutdown 2024-04-17T02:22:22.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.893+0000 7f0874a64640 1 -- 172.21.15.17:0/926729340 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f085009f480 msgr2=0x7f08500a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:22.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.893+0000 7f0874a64640 1 --2- 172.21.15.17:0/926729340 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f085009f480 0x7f08500a1940 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0870068370 tx=0x7f0864007b70 comp rx=0 tx=0).stop 2024-04-17T02:22:22.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.893+0000 7f0874a64640 1 -- 172.21.15.17:0/926729340 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f08700ab5b0 msgr2=0x7f0870145d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:22.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.893+0000 7f0874a64640 1 --2- 172.21.15.17:0/926729340 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f08700ab5b0 0x7f0870145d70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f08600098f0 tx=0x7f08600046c0 comp rx=0 tx=0).stop 2024-04-17T02:22:22.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.893+0000 7f0874a64640 1 -- 172.21.15.17:0/926729340 shutdown_connections 2024-04-17T02:22:22.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.893+0000 7f0874a64640 1 --2- 172.21.15.17:0/926729340 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f085009f480 0x7f08500a1940 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:22.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.893+0000 7f0874a64640 1 --2- 172.21.15.17:0/926729340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0870142c90 0x7f08700a2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:22.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.893+0000 7f0874a64640 1 --2- 172.21.15.17:0/926729340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08700bb460 0x7f087013cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:22.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.893+0000 7f0874a64640 1 --2- 172.21.15.17:0/926729340 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f08700ab5b0 0x7f0870145d70 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:22.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.893+0000 7f0874a64640 1 -- 172.21.15.17:0/926729340 >> 172.21.15.17:0/926729340 conn(0x7f08700ba940 msgr2=0x7f08700a5400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:22.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.893+0000 7f0874a64640 1 -- 172.21.15.17:0/926729340 shutdown_connections 2024-04-17T02:22:22.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:22.893+0000 7f0874a64640 1 -- 172.21.15.17:0/926729340 wait complete. 2024-04-17T02:22:22.905 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-17T02:22:23.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.011+0000 7f0376227640 1 Processor -- start 2024-04-17T02:22:23.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.011+0000 7f0376227640 1 -- start start 2024-04-17T02:22:23.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.012+0000 7f0376227640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f0370070c10 0x7f03700a5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:23.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.012+0000 7f0376227640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f037006e9b0 con 0x7f037006b370 2024-04-17T02:22:23.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.012+0000 7f0376227640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03700712a0 con 0x7f037014b7e0 2024-04-17T02:22:23.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.012+0000 7f0376227640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f037006b750 con 0x7f0370070c10 2024-04-17T02:22:23.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.012+0000 7f036f7fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f037006b370 0x7f03701435f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39846/0 (socket says 172.21.15.17:39846) 2024-04-17T02:22:23.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.012+0000 7f036f7fe640 1 -- 172.21.15.17:0/4270880942 learned_addr learned my addr 172.21.15.17:0/4270880942 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:22:23.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.012+0000 7f036effd640 1 --2- 172.21.15.17:0/4270880942 >> v2:172.21.15.122:3300/0 conn(0x7f0370070c10 0x7f03700a5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:23.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.012+0000 7f036e7fc640 1 -- 172.21.15.17:0/4270880942 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1865956366 0 0) 0x7f037006e9b0 con 0x7f037006b370 2024-04-17T02:22:23.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.012+0000 7f036e7fc640 1 -- 172.21.15.17:0/4270880942 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0358003520 con 0x7f037006b370 2024-04-17T02:22:23.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.012+0000 7f036e7fc640 1 -- 172.21.15.17:0/4270880942 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 833564687 0 0) 0x7f03700712a0 con 0x7f037014b7e0 2024-04-17T02:22:23.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.012+0000 7f036e7fc640 1 -- 172.21.15.17:0/4270880942 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f037006e9b0 con 0x7f037014b7e0 2024-04-17T02:22:23.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.012+0000 7f036e7fc640 1 -- 172.21.15.17:0/4270880942 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1473544848 0 0) 0x7f0358003520 con 0x7f037006b370 2024-04-17T02:22:23.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.012+0000 7f036e7fc640 1 -- 172.21.15.17:0/4270880942 >> v2:172.21.15.122:3300/0 conn(0x7f0370070c10 msgr2=0x7f03700a5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:23.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.012+0000 7f036e7fc640 1 --2- 172.21.15.17:0/4270880942 >> v2:172.21.15.122:3300/0 conn(0x7f0370070c10 0x7f03700a5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:23.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.012+0000 7f036e7fc640 1 -- 172.21.15.17:0/4270880942 >> v1:172.21.15.122:6789/0 conn(0x7f037014b7e0 legacy=0x7f037014dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:23.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.012+0000 7f036e7fc640 1 -- 172.21.15.17:0/4270880942 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0370071560 con 0x7f037006b370 2024-04-17T02:22:23.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.012+0000 7f036e7fc640 1 -- 172.21.15.17:0/4270880942 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1752030744 0 0) 0x7f0360001670 con 0x7f037006b370 2024-04-17T02:22:23.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.012+0000 7f036effd640 1 --2- 172.21.15.17:0/4270880942 >> v2:172.21.15.122:3300/0 conn(0x7f0370070c10 0x7f03700a5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:23.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.012+0000 7f036e7fc640 1 -- 172.21.15.17:0/4270880942 >> v1:172.21.15.17:6789/0 conn(0x7f037006b370 legacy=0x7f03701435f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:23.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.012+0000 7f036e7fc640 1 --2- 172.21.15.17:0/4270880942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0358003b40 0x7f0358003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:23.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.012+0000 7f036e7fc640 1 --2- 172.21.15.17:0/4270880942 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0358004800 0x7f0358004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:23.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.012+0000 7f036e7fc640 1 --2- 172.21.15.17:0/4270880942 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f03580051c0 0x7f035800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:23.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.012+0000 7f036e7fc640 1 -- 172.21.15.17:0/4270880942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f037006b750 con 0x7f0358003b40 2024-04-17T02:22:23.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.012+0000 7f036e7fc640 1 -- 172.21.15.17:0/4270880942 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f035800c0f0 con 0x7f0358004800 2024-04-17T02:22:23.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.013+0000 7f036e7fc640 1 -- 172.21.15.17:0/4270880942 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f035800c2f0 con 0x7f03580051c0 2024-04-17T02:22:23.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.013+0000 7f036f7fe640 1 --2- 172.21.15.17:0/4270880942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0358003b40 0x7f0358003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:23.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.013+0000 7f036ffff640 1 --2- 172.21.15.17:0/4270880942 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f03580051c0 0x7f035800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:23.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.013+0000 7f036effd640 1 --2- 172.21.15.17:0/4270880942 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0358004800 0x7f0358004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:23.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.013+0000 7f036f7fe640 1 -- 172.21.15.17:0/4270880942 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f03580051c0 msgr2=0x7f035800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:23.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.013+0000 7f036f7fe640 1 --2- 172.21.15.17:0/4270880942 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f03580051c0 0x7f035800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:23.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.013+0000 7f036f7fe640 1 -- 172.21.15.17:0/4270880942 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0358004800 msgr2=0x7f0358004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:23.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.013+0000 7f036f7fe640 1 --2- 172.21.15.17:0/4270880942 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0358004800 0x7f0358004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:23.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.013+0000 7f036f7fe640 1 -- 172.21.15.17:0/4270880942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0358003520 con 0x7f0358003b40 2024-04-17T02:22:23.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.013+0000 7f036ffff640 1 -- 172.21.15.17:0/4270880942 reap_dead start 2024-04-17T02:22:23.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.014+0000 7f036f7fe640 1 --2- 172.21.15.17:0/4270880942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0358003b40 0x7f0358003f40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f036000c1c0 tx=0x7f0358005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab20a4e72c0e911 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:23.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.014+0000 7f036e7fc640 1 -- 172.21.15.17:0/4270880942 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0360007cc0 con 0x7f0358003b40 2024-04-17T02:22:23.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.014+0000 7f036e7fc640 1 -- 172.21.15.17:0/4270880942 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0360030070 con 0x7f0358003b40 2024-04-17T02:22:23.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.014+0000 7f036e7fc640 1 -- 172.21.15.17:0/4270880942 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0360005d50 con 0x7f0358003b40 2024-04-17T02:22:23.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.014+0000 7f0376227640 1 -- 172.21.15.17:0/4270880942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0358003b40 msgr2=0x7f0358003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:23.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.014+0000 7f0376227640 1 --2- 172.21.15.17:0/4270880942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0358003b40 0x7f0358003f40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f036000c1c0 tx=0x7f0358005830 comp rx=0 tx=0).stop 2024-04-17T02:22:23.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.014+0000 7f0376227640 1 -- 172.21.15.17:0/4270880942 shutdown_connections 2024-04-17T02:22:23.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.014+0000 7f0376227640 1 --2- 172.21.15.17:0/4270880942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0358003b40 0x7f0358003f40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:23.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.014+0000 7f0376227640 1 -- 172.21.15.17:0/4270880942 >> 172.21.15.17:0/4270880942 conn(0x7f03700a6ab0 msgr2=0x7f03700a6ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:23.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.014+0000 7f0376227640 1 -- 172.21.15.17:0/4270880942 shutdown_connections 2024-04-17T02:22:23.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.014+0000 7f0376227640 1 -- 172.21.15.17:0/4270880942 wait complete. 2024-04-17T02:22:23.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.015+0000 7f0376227640 1 Processor -- start 2024-04-17T02:22:23.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.016+0000 7f0376227640 1 -- start start 2024-04-17T02:22:23.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.016+0000 7f0376227640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0358003b40 0x7f03701476a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:23.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.016+0000 7f0376227640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f0370147be0 0x7f03701d8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:23.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.016+0000 7f0376227640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03701d8ec0 0x7f0370145e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:23.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.016+0000 7f0376227640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0370071060 con 0x7f03701d8ec0 2024-04-17T02:22:23.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.016+0000 7f0376227640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f03700a5ff0 con 0x7f0358003b40 2024-04-17T02:22:23.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.016+0000 7f0376227640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f03700a52b0 con 0x7f0370147be0 2024-04-17T02:22:23.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.016+0000 7f036effd640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f0370147be0 0x7f03701d8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:23.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.016+0000 7f036effd640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f0370147be0 0x7f03701d8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:57960/0 (socket says 172.21.15.17:57960) 2024-04-17T02:22:23.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.016+0000 7f036effd640 1 -- 172.21.15.17:0/363511328 learned_addr learned my addr 172.21.15.17:0/363511328 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:23.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.016+0000 7f036ffff640 1 --2- 172.21.15.17:0/363511328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03701d8ec0 0x7f0370145e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:23.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.016+0000 7f036f7fe640 1 --2- 172.21.15.17:0/363511328 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0358003b40 0x7f03701476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:23.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.016+0000 7f036effd640 1 -- 172.21.15.17:0/363511328 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0358003b40 msgr2=0x7f03701476a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:23.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.016+0000 7f036effd640 1 --2- 172.21.15.17:0/363511328 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0358003b40 0x7f03701476a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:23.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.016+0000 7f036effd640 1 -- 172.21.15.17:0/363511328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03701d8ec0 msgr2=0x7f0370145e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:23.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.016+0000 7f036effd640 1 --2- 172.21.15.17:0/363511328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03701d8ec0 0x7f0370145e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:23.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.016+0000 7f036effd640 1 -- 172.21.15.17:0/363511328 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03700b6b20 con 0x7f0370147be0 2024-04-17T02:22:23.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.016+0000 7f036ffff640 1 --2- 172.21.15.17:0/363511328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03701d8ec0 0x7f0370145e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:23.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.017+0000 7f036effd640 1 --2- 172.21.15.17:0/363511328 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f0370147be0 0x7f03701d8980 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0364011d30 tx=0x7f036400f610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:23.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.017+0000 7f0357fff640 1 -- 172.21.15.17:0/363511328 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036400fd20 con 0x7f0370147be0 2024-04-17T02:22:23.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.017+0000 7f0357fff640 1 -- 172.21.15.17:0/363511328 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0364004030 con 0x7f0370147be0 2024-04-17T02:22:23.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.017+0000 7f0376227640 1 -- 172.21.15.17:0/363511328 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03700b6de0 con 0x7f0370147be0 2024-04-17T02:22:23.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.017+0000 7f0357fff640 1 -- 172.21.15.17:0/363511328 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0364004420 con 0x7f0370147be0 2024-04-17T02:22:23.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.017+0000 7f0376227640 1 -- 172.21.15.17:0/363511328 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f03700b84c0 con 0x7f0370147be0 2024-04-17T02:22:23.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.018+0000 7f0376227640 1 -- 172.21.15.17:0/363511328 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f037014b3a0 con 0x7f0370147be0 2024-04-17T02:22:23.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.019+0000 7f0357fff640 1 -- 172.21.15.17:0/363511328 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f0364012040 con 0x7f0370147be0 2024-04-17T02:22:23.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.019+0000 7f0357fff640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:23.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.020+0000 7f0357fff640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:23.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.020+0000 7f0357fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:23.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.020+0000 7f0357fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:23.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.020+0000 7f0357fff640 1 --2- 172.21.15.17:0/363511328 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f035c09f480 0x7f035c0a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:23.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.020+0000 7f036f7fe640 1 --2- 172.21.15.17:0/363511328 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f035c09f480 0x7f035c0a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:23.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.020+0000 7f0357fff640 1 -- 172.21.15.17:0/363511328 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(19..19 src has 1..19) ==== 4334+0+0 (secure 0 0 0) 0x7f03640c9a80 con 0x7f0370147be0 2024-04-17T02:22:23.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.020+0000 7f036f7fe640 1 --2- 172.21.15.17:0/363511328 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f035c09f480 0x7f035c0a1940 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0360034000 tx=0x7f0360039040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:23.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.024+0000 7f0357fff640 1 -- 172.21.15.17:0/363511328 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f03640cbe20 con 0x7f0370147be0 2024-04-17T02:22:23.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.246+0000 7f0376227640 1 -- 172.21.15.17:0/363511328 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f03700687f0 con 0x7f0370147be0 2024-04-17T02:22:23.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.256+0000 7f0357fff640 1 -- 172.21.15.17:0/363511328 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7f0364019070 con 0x7f0370147be0 2024-04-17T02:22:23.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.259+0000 7f0376227640 10 mgrc shutdown 2024-04-17T02:22:23.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.259+0000 7f0376227640 1 -- 172.21.15.17:0/363511328 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f035c09f480 msgr2=0x7f035c0a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:23.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.259+0000 7f0376227640 1 --2- 172.21.15.17:0/363511328 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f035c09f480 0x7f035c0a1940 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0360034000 tx=0x7f0360039040 comp rx=0 tx=0).stop 2024-04-17T02:22:23.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.259+0000 7f0376227640 1 -- 172.21.15.17:0/363511328 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f0370147be0 msgr2=0x7f03701d8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:23.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.259+0000 7f0376227640 1 --2- 172.21.15.17:0/363511328 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f0370147be0 0x7f03701d8980 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0364011d30 tx=0x7f036400f610 comp rx=0 tx=0).stop 2024-04-17T02:22:23.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.259+0000 7f0376227640 1 -- 172.21.15.17:0/363511328 shutdown_connections 2024-04-17T02:22:23.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.259+0000 7f0376227640 1 --2- 172.21.15.17:0/363511328 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f035c09f480 0x7f035c0a1940 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:23.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.259+0000 7f0376227640 1 --2- 172.21.15.17:0/363511328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03701d8ec0 0x7f0370145e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:23.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.259+0000 7f0376227640 1 --2- 172.21.15.17:0/363511328 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f0370147be0 0x7f03701d8980 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:23.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.259+0000 7f0376227640 1 --2- 172.21.15.17:0/363511328 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0358003b40 0x7f03701476a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:23.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.259+0000 7f0376227640 1 -- 172.21.15.17:0/363511328 >> 172.21.15.17:0/363511328 conn(0x7f03700a6ab0 msgr2=0x7f0370142350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:23.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.259+0000 7f0376227640 1 -- 172.21.15.17:0/363511328 shutdown_connections 2024-04-17T02:22:23.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.259+0000 7f0376227640 1 -- 172.21.15.17:0/363511328 wait complete. 2024-04-17T02:22:23.271 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-17T02:22:23.271 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-17T02:22:23.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.378+0000 7f0a30019640 1 Processor -- start 2024-04-17T02:22:23.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.378+0000 7f0a30019640 1 -- start start 2024-04-17T02:22:23.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.379+0000 7f0a30019640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f0a280ab3b0 0x7f0a280ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:23.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.379+0000 7f0a30019640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0a280acce0 0x7f0a2814f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:23.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.379+0000 7f0a30019640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a280a7f00 con 0x7f0a280a9560 2024-04-17T02:22:23.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.379+0000 7f0a30019640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f0a280abd20 con 0x7f0a280acce0 2024-04-17T02:22:23.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.379+0000 7f0a30019640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f0a280ac000 con 0x7f0a280ab3b0 2024-04-17T02:22:23.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.379+0000 7f0a2e5b6640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0a280acce0 0x7f0a2814f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:23.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.379+0000 7f0a2d5b4640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f0a280a9560 0x7f0a28145730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39858/0 (socket says 172.21.15.17:39858) 2024-04-17T02:22:23.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.379+0000 7f0a2d5b4640 1 -- 172.21.15.17:0/3114396687 learned_addr learned my addr 172.21.15.17:0/3114396687 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:22:23.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.379+0000 7f0a2ddb5640 1 --2- 172.21.15.17:0/3114396687 >> v2:172.21.15.122:3300/0 conn(0x7f0a280ab3b0 0x7f0a280ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:23.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.379+0000 7f0a2e5b6640 1 -- 172.21.15.17:0/3114396687 >> v2:172.21.15.122:3300/0 conn(0x7f0a280ab3b0 msgr2=0x7f0a280ac7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:23.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.379+0000 7f0a2e5b6640 1 --2- 172.21.15.17:0/3114396687 >> v2:172.21.15.122:3300/0 conn(0x7f0a280ab3b0 0x7f0a280ac7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:23.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.379+0000 7f0a2cdb3640 1 -- 172.21.15.17:0/3114396687 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1407677310 0 0) 0x7f0a280a7f00 con 0x7f0a280a9560 2024-04-17T02:22:23.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.379+0000 7f0a2e5b6640 1 -- 172.21.15.17:0/3114396687 >> v1:172.21.15.17:6789/0 conn(0x7f0a280a9560 legacy=0x7f0a28145730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:23.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.379+0000 7f0a2e5b6640 1 -- 172.21.15.17:0/3114396687 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a280a7960 con 0x7f0a280acce0 2024-04-17T02:22:23.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.380+0000 7f0a2e5b6640 1 --2- 172.21.15.17:0/3114396687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a280acce0 0x7f0a2814f960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0a200097a0 tx=0x7f0a2002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=986ca86b299a1978 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:23.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.380+0000 7f0a2cdb3640 1 -- 172.21.15.17:0/3114396687 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a200315a0 con 0x7f0a280acce0 2024-04-17T02:22:23.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.380+0000 7f0a2cdb3640 1 -- 172.21.15.17:0/3114396687 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a20037070 con 0x7f0a280acce0 2024-04-17T02:22:23.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.380+0000 7f0a2cdb3640 1 -- 172.21.15.17:0/3114396687 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a20031960 con 0x7f0a280acce0 2024-04-17T02:22:23.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.381+0000 7f0a30019640 1 -- 172.21.15.17:0/3114396687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a280acce0 msgr2=0x7f0a2814f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:23.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.381+0000 7f0a30019640 1 --2- 172.21.15.17:0/3114396687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a280acce0 0x7f0a2814f960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0a200097a0 tx=0x7f0a2002b840 comp rx=0 tx=0).stop 2024-04-17T02:22:23.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.381+0000 7f0a30019640 1 -- 172.21.15.17:0/3114396687 shutdown_connections 2024-04-17T02:22:23.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.381+0000 7f0a30019640 1 --2- 172.21.15.17:0/3114396687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a280acce0 0x7f0a2814f960 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:23.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.381+0000 7f0a30019640 1 --2- 172.21.15.17:0/3114396687 >> v2:172.21.15.122:3300/0 conn(0x7f0a280ab3b0 0x7f0a280ac7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:23.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.381+0000 7f0a30019640 1 -- 172.21.15.17:0/3114396687 >> 172.21.15.17:0/3114396687 conn(0x7f0a280a9b60 msgr2=0x7f0a280a9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:23.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.381+0000 7f0a30019640 1 -- 172.21.15.17:0/3114396687 shutdown_connections 2024-04-17T02:22:23.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.381+0000 7f0a30019640 1 -- 172.21.15.17:0/3114396687 wait complete. 2024-04-17T02:22:23.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.382+0000 7f0a30019640 1 Processor -- start 2024-04-17T02:22:23.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.382+0000 7f0a30019640 1 -- start start 2024-04-17T02:22:23.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.382+0000 7f0a30019640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0a280a9560 0x7f0a2809a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:23.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.382+0000 7f0a30019640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f0a280ab3b0 0x7f0a2809bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:23.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.382+0000 7f0a30019640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a280acce0 0x7f0a28141880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:23.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.382+0000 7f0a30019640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0a2806b5b0 con 0x7f0a280acce0 2024-04-17T02:22:23.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.382+0000 7f0a30019640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0a28145e40 con 0x7f0a280a9560 2024-04-17T02:22:23.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.382+0000 7f0a30019640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f0a281cf5a0 con 0x7f0a280ab3b0 2024-04-17T02:22:23.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.383+0000 7f0a2e5b6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a280acce0 0x7f0a28141880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:23.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.383+0000 7f0a2d5b4640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f0a280ab3b0 0x7f0a2809bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:23.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.383+0000 7f0a2e5b6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a280acce0 0x7f0a28141880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44514/0 (socket says 172.21.15.17:44514) 2024-04-17T02:22:23.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.383+0000 7f0a2e5b6640 1 -- 172.21.15.17:0/1840314216 learned_addr learned my addr 172.21.15.17:0/1840314216 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:23.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.383+0000 7f0a2ddb5640 1 --2- 172.21.15.17:0/1840314216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0a280a9560 0x7f0a2809a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:23.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.383+0000 7f0a2e5b6640 1 -- 172.21.15.17:0/1840314216 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f0a280ab3b0 msgr2=0x7f0a2809bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:23.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.383+0000 7f0a2e5b6640 1 --2- 172.21.15.17:0/1840314216 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f0a280ab3b0 0x7f0a2809bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:23.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.383+0000 7f0a2e5b6640 1 -- 172.21.15.17:0/1840314216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0a280a9560 msgr2=0x7f0a2809a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:23.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.383+0000 7f0a2e5b6640 1 --2- 172.21.15.17:0/1840314216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0a280a9560 0x7f0a2809a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:23.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.383+0000 7f0a2e5b6640 1 -- 172.21.15.17:0/1840314216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a2809a950 con 0x7f0a280acce0 2024-04-17T02:22:23.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.383+0000 7f0a2ddb5640 1 --2- 172.21.15.17:0/1840314216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0a280a9560 0x7f0a2809a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T02:22:23.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.383+0000 7f0a2d5b4640 1 --2- 172.21.15.17:0/1840314216 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f0a280ab3b0 0x7f0a2809bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:23.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.383+0000 7f0a2e5b6640 1 --2- 172.21.15.17:0/1840314216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a280acce0 0x7f0a28141880 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0a200097a0 tx=0x7f0a200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:23.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.383+0000 7f0a267fc640 1 -- 172.21.15.17:0/1840314216 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a20004230 con 0x7f0a280acce0 2024-04-17T02:22:23.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.383+0000 7f0a267fc640 1 -- 172.21.15.17:0/1840314216 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a200043f0 con 0x7f0a280acce0 2024-04-17T02:22:23.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.383+0000 7f0a30019640 1 -- 172.21.15.17:0/1840314216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a2809b170 con 0x7f0a280acce0 2024-04-17T02:22:23.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.383+0000 7f0a267fc640 1 -- 172.21.15.17:0/1840314216 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a20003850 con 0x7f0a280acce0 2024-04-17T02:22:23.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.383+0000 7f0a30019640 1 -- 172.21.15.17:0/1840314216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a2809abf0 con 0x7f0a280acce0 2024-04-17T02:22:23.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.384+0000 7f0a30019640 1 -- 172.21.15.17:0/1840314216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a280687f0 con 0x7f0a280acce0 2024-04-17T02:22:23.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.385+0000 7f0a267fc640 1 -- 172.21.15.17:0/1840314216 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f0a200039f0 con 0x7f0a280acce0 2024-04-17T02:22:23.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.385+0000 7f0a267fc640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:23.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.386+0000 7f0a267fc640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:23.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.386+0000 7f0a267fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:23.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.386+0000 7f0a267fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:23.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.386+0000 7f0a267fc640 1 --2- 172.21.15.17:0/1840314216 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f0a1409f480 0x7f0a140a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:23.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.386+0000 7f0a2ddb5640 1 --2- 172.21.15.17:0/1840314216 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f0a1409f480 0x7f0a140a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:23.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.386+0000 7f0a267fc640 1 -- 172.21.15.17:0/1840314216 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f0a2002f030 con 0x7f0a280acce0 2024-04-17T02:22:23.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.387+0000 7f0a2ddb5640 1 --2- 172.21.15.17:0/1840314216 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f0a1409f480 0x7f0a140a1940 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0a18007520 tx=0x7f0a1800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:23.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.390+0000 7f0a267fc640 1 -- 172.21.15.17:0/1840314216 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0a20041070 con 0x7f0a280acce0 2024-04-17T02:22:23.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:23.607+0000 7f0a30019640 1 -- 172.21.15.17:0/1840314216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f0a2806c250 con 0x7f0a280acce0 2024-04-17T02:22:24.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.262+0000 7f0a267fc640 1 -- 172.21.15.17:0/1840314216 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7f0a200ba5b0 con 0x7f0a280acce0 2024-04-17T02:22:24.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.264+0000 7f0a30019640 10 mgrc shutdown 2024-04-17T02:22:24.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.265+0000 7f0a30019640 1 -- 172.21.15.17:0/1840314216 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f0a1409f480 msgr2=0x7f0a140a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:24.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.265+0000 7f0a30019640 1 --2- 172.21.15.17:0/1840314216 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f0a1409f480 0x7f0a140a1940 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0a18007520 tx=0x7f0a1800b040 comp rx=0 tx=0).stop 2024-04-17T02:22:24.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.265+0000 7f0a30019640 1 -- 172.21.15.17:0/1840314216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a280acce0 msgr2=0x7f0a28141880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:24.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.265+0000 7f0a30019640 1 --2- 172.21.15.17:0/1840314216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a280acce0 0x7f0a28141880 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0a200097a0 tx=0x7f0a200046c0 comp rx=0 tx=0).stop 2024-04-17T02:22:24.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.265+0000 7f0a30019640 1 -- 172.21.15.17:0/1840314216 shutdown_connections 2024-04-17T02:22:24.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.265+0000 7f0a30019640 1 --2- 172.21.15.17:0/1840314216 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f0a1409f480 0x7f0a140a1940 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:24.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.265+0000 7f0a30019640 1 --2- 172.21.15.17:0/1840314216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a280acce0 0x7f0a28141880 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:24.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.265+0000 7f0a30019640 1 --2- 172.21.15.17:0/1840314216 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f0a280ab3b0 0x7f0a2809bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:24.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.265+0000 7f0a30019640 1 --2- 172.21.15.17:0/1840314216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0a280a9560 0x7f0a2809a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:24.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.265+0000 7f0a30019640 1 -- 172.21.15.17:0/1840314216 >> 172.21.15.17:0/1840314216 conn(0x7f0a280a9b60 msgr2=0x7f0a280a5ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:24.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.265+0000 7f0a30019640 1 -- 172.21.15.17:0/1840314216 shutdown_connections 2024-04-17T02:22:24.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.265+0000 7f0a30019640 1 -- 172.21.15.17:0/1840314216 wait complete. 2024-04-17T02:22:24.279 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-17T02:22:24.279 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T02:22:24.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.387+0000 7fdf5e025640 1 Processor -- start 2024-04-17T02:22:24.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.387+0000 7fdf5e025640 1 -- start start 2024-04-17T02:22:24.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.388+0000 7fdf5e025640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fdf580a5f30 0x7fdf580a82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:24.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.388+0000 7fdf5e025640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fdf58143c70 0x7fdf5814d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:24.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.388+0000 7fdf5e025640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf580a8f30 con 0x7fdf580733d0 2024-04-17T02:22:24.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.388+0000 7fdf5e025640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fdf580a7360 con 0x7fdf580a5f30 2024-04-17T02:22:24.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.388+0000 7fdf5e025640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fdf580a7620 con 0x7fdf58143c70 2024-04-17T02:22:24.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.388+0000 7fdf57fff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fdf58143c70 0x7fdf5814d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:24.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.388+0000 7fdf57fff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fdf58143c70 0x7fdf5814d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:57984/0 (socket says 172.21.15.17:57984) 2024-04-17T02:22:24.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.388+0000 7fdf56ffd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fdf580733d0 0x7fdf58143560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39860/0 (socket says 172.21.15.17:39860) 2024-04-17T02:22:24.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.388+0000 7fdf57fff640 1 -- 172.21.15.17:0/3019780320 learned_addr learned my addr 172.21.15.17:0/3019780320 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:24.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.388+0000 7fdf577fe640 1 --2- 172.21.15.17:0/3019780320 >> v2:172.21.15.122:3300/0 conn(0x7fdf580a5f30 0x7fdf580a82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:24.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.389+0000 7fdf57fff640 1 -- 172.21.15.17:0/3019780320 >> v2:172.21.15.122:3300/0 conn(0x7fdf580a5f30 msgr2=0x7fdf580a82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:24.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.389+0000 7fdf57fff640 1 --2- 172.21.15.17:0/3019780320 >> v2:172.21.15.122:3300/0 conn(0x7fdf580a5f30 0x7fdf580a82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:24.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.388+0000 7fdf567fc640 1 -- 172.21.15.17:0/3019780320 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 271032228 0 0) 0x7fdf580a8f30 con 0x7fdf580733d0 2024-04-17T02:22:24.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.389+0000 7fdf57fff640 1 -- 172.21.15.17:0/3019780320 >> v1:172.21.15.17:6789/0 conn(0x7fdf580733d0 legacy=0x7fdf58143560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:24.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.389+0000 7fdf57fff640 1 -- 172.21.15.17:0/3019780320 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf580a7080 con 0x7fdf58143c70 2024-04-17T02:22:24.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.389+0000 7fdf57fff640 1 --2- 172.21.15.17:0/3019780320 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fdf58143c70 0x7fdf5814d7f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdf50009870 tx=0x7fdf5002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b1c84beee2c79ac server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:24.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.389+0000 7fdf567fc640 1 -- 172.21.15.17:0/3019780320 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf50035020 con 0x7fdf58143c70 2024-04-17T02:22:24.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.389+0000 7fdf567fc640 1 -- 172.21.15.17:0/3019780320 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf50031640 con 0x7fdf58143c70 2024-04-17T02:22:24.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.389+0000 7fdf567fc640 1 -- 172.21.15.17:0/3019780320 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf5002d040 con 0x7fdf58143c70 2024-04-17T02:22:24.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.390+0000 7fdf5e025640 1 -- 172.21.15.17:0/3019780320 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fdf58143c70 msgr2=0x7fdf5814d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:24.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.390+0000 7fdf5e025640 1 --2- 172.21.15.17:0/3019780320 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fdf58143c70 0x7fdf5814d7f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdf50009870 tx=0x7fdf5002b8f0 comp rx=0 tx=0).stop 2024-04-17T02:22:24.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.390+0000 7fdf5e025640 1 -- 172.21.15.17:0/3019780320 shutdown_connections 2024-04-17T02:22:24.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.390+0000 7fdf5e025640 1 --2- 172.21.15.17:0/3019780320 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fdf58143c70 0x7fdf5814d7f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:24.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.390+0000 7fdf5e025640 1 --2- 172.21.15.17:0/3019780320 >> v2:172.21.15.122:3300/0 conn(0x7fdf580a5f30 0x7fdf580a82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:24.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.390+0000 7fdf5e025640 1 -- 172.21.15.17:0/3019780320 >> 172.21.15.17:0/3019780320 conn(0x7fdf580746d0 msgr2=0x7fdf580a7ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:24.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.390+0000 7fdf5e025640 1 -- 172.21.15.17:0/3019780320 shutdown_connections 2024-04-17T02:22:24.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.390+0000 7fdf5e025640 1 -- 172.21.15.17:0/3019780320 wait complete. 2024-04-17T02:22:24.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.391+0000 7fdf5e025640 1 Processor -- start 2024-04-17T02:22:24.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.391+0000 7fdf5e025640 1 -- start start 2024-04-17T02:22:24.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.392+0000 7fdf5e025640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fdf580733d0 0x7fdf5813f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:24.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.392+0000 7fdf5e025640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf580a5f30 0x7fdf5806d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:24.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.392+0000 7fdf5e025640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf58143c70 0x7fdf5813c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:24.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.392+0000 7fdf5e025640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdf580a6490 con 0x7fdf580a5f30 2024-04-17T02:22:24.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.392+0000 7fdf5e025640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fdf580a6310 con 0x7fdf58143c70 2024-04-17T02:22:24.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.392+0000 7fdf5e025640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fdf580aaf00 con 0x7fdf580733d0 2024-04-17T02:22:24.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.392+0000 7fdf577fe640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fdf580733d0 0x7fdf5813f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:24.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.392+0000 7fdf56ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf580a5f30 0x7fdf5806d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:24.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.392+0000 7fdf577fe640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fdf580733d0 0x7fdf5813f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:57988/0 (socket says 172.21.15.17:57988) 2024-04-17T02:22:24.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.392+0000 7fdf577fe640 1 -- 172.21.15.17:0/2829826633 learned_addr learned my addr 172.21.15.17:0/2829826633 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:24.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.392+0000 7fdf57fff640 1 --2- 172.21.15.17:0/2829826633 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf58143c70 0x7fdf5813c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:24.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.392+0000 7fdf577fe640 1 -- 172.21.15.17:0/2829826633 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf58143c70 msgr2=0x7fdf5813c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:24.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.392+0000 7fdf577fe640 1 --2- 172.21.15.17:0/2829826633 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf58143c70 0x7fdf5813c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:24.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.392+0000 7fdf577fe640 1 -- 172.21.15.17:0/2829826633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf580a5f30 msgr2=0x7fdf5806d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:24.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.392+0000 7fdf577fe640 1 --2- 172.21.15.17:0/2829826633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf580a5f30 0x7fdf5806d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:24.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.392+0000 7fdf577fe640 1 -- 172.21.15.17:0/2829826633 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf5813d670 con 0x7fdf580733d0 2024-04-17T02:22:24.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.392+0000 7fdf56ffd640 1 --2- 172.21.15.17:0/2829826633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf580a5f30 0x7fdf5806d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:24.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.392+0000 7fdf577fe640 1 --2- 172.21.15.17:0/2829826633 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fdf580733d0 0x7fdf5813f940 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdf48009db0 tx=0x7fdf4800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:24.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.393+0000 7fdf3ffff640 1 -- 172.21.15.17:0/2829826633 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf48018020 con 0x7fdf580733d0 2024-04-17T02:22:24.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.393+0000 7fdf3ffff640 1 -- 172.21.15.17:0/2829826633 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf48014480 con 0x7fdf580733d0 2024-04-17T02:22:24.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.393+0000 7fdf5e025640 1 -- 172.21.15.17:0/2829826633 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf5813d910 con 0x7fdf580733d0 2024-04-17T02:22:24.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.393+0000 7fdf3ffff640 1 -- 172.21.15.17:0/2829826633 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf48014850 con 0x7fdf580733d0 2024-04-17T02:22:24.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.393+0000 7fdf5e025640 1 -- 172.21.15.17:0/2829826633 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf5806cd90 con 0x7fdf580733d0 2024-04-17T02:22:24.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.394+0000 7fdf5e025640 1 -- 172.21.15.17:0/2829826633 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf580687f0 con 0x7fdf580733d0 2024-04-17T02:22:24.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.395+0000 7fdf3ffff640 1 -- 172.21.15.17:0/2829826633 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7fdf48005d10 con 0x7fdf580733d0 2024-04-17T02:22:24.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.395+0000 7fdf3ffff640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:24.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.395+0000 7fdf3ffff640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:24.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.395+0000 7fdf3ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:24.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.395+0000 7fdf3ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:24.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.395+0000 7fdf3ffff640 1 --2- 172.21.15.17:0/2829826633 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fdf4409f4b0 0x7fdf440a1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:24.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.395+0000 7fdf56ffd640 1 --2- 172.21.15.17:0/2829826633 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fdf4409f4b0 0x7fdf440a1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:24.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.396+0000 7fdf3ffff640 1 -- 172.21.15.17:0/2829826633 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7fdf480ca5a0 con 0x7fdf580733d0 2024-04-17T02:22:24.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.396+0000 7fdf56ffd640 1 --2- 172.21.15.17:0/2829826633 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fdf4409f4b0 0x7fdf440a1970 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdf580730b0 tx=0x7fdf4c007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:24.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.399+0000 7fdf3ffff640 1 -- 172.21.15.17:0/2829826633 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fdf48022070 con 0x7fdf580733d0 2024-04-17T02:22:24.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.619+0000 7fdf5e025640 1 -- 172.21.15.17:0/2829826633 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf580b7200 con 0x7fdf580733d0 2024-04-17T02:22:24.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.619+0000 7fdf3ffff640 1 -- 172.21.15.17:0/2829826633 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4348 (secure 0 0 0) 0x7fdf48010040 con 0x7fdf580733d0 2024-04-17T02:22:24.620 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:22:24.621 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4228,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6813/1946927344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6811","nonce":1946927344},{"type":"v1","addr":"172.21.15.17:6813","nonce":1946927344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4234,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6825/529920036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":529920036},{"type":"v1","addr":"172.21.15.122:6825","nonce":529920036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T02:22:21.611698+0000","modified":"2024-04-17T02:22:23.609137+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6812/356803728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":356803728},{"type":"v1","addr":"172.21.15.17:6812","nonce":356803728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4254,"qdb_cluster":[4254]},"id":1}]} 2024-04-17T02:22:24.621 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 6 2024-04-17T02:22:24.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.621+0000 7fdf5e025640 10 mgrc shutdown 2024-04-17T02:22:24.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.621+0000 7fdf5e025640 1 -- 172.21.15.17:0/2829826633 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fdf4409f4b0 msgr2=0x7fdf440a1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:24.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.621+0000 7fdf5e025640 1 --2- 172.21.15.17:0/2829826633 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fdf4409f4b0 0x7fdf440a1970 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdf580730b0 tx=0x7fdf4c007d50 comp rx=0 tx=0).stop 2024-04-17T02:22:24.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.621+0000 7fdf5e025640 1 -- 172.21.15.17:0/2829826633 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fdf580733d0 msgr2=0x7fdf5813f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:24.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.621+0000 7fdf5e025640 1 --2- 172.21.15.17:0/2829826633 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fdf580733d0 0x7fdf5813f940 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdf48009db0 tx=0x7fdf4800c490 comp rx=0 tx=0).stop 2024-04-17T02:22:24.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.621+0000 7fdf5e025640 1 -- 172.21.15.17:0/2829826633 shutdown_connections 2024-04-17T02:22:24.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.621+0000 7fdf5e025640 1 --2- 172.21.15.17:0/2829826633 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fdf4409f4b0 0x7fdf440a1970 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:24.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.621+0000 7fdf5e025640 1 --2- 172.21.15.17:0/2829826633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf580a5f30 0x7fdf5806d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:24.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.621+0000 7fdf5e025640 1 --2- 172.21.15.17:0/2829826633 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf58143c70 0x7fdf5813c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:24.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.621+0000 7fdf5e025640 1 --2- 172.21.15.17:0/2829826633 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fdf580733d0 0x7fdf5813f940 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:24.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.621+0000 7fdf5e025640 1 -- 172.21.15.17:0/2829826633 >> 172.21.15.17:0/2829826633 conn(0x7fdf580746d0 msgr2=0x7fdf58068ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:24.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.621+0000 7fdf5e025640 1 -- 172.21.15.17:0/2829826633 shutdown_connections 2024-04-17T02:22:24.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.621+0000 7fdf5e025640 1 -- 172.21.15.17:0/2829826633 wait complete. 2024-04-17T02:22:24.633 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T02:22:24.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.736+0000 7f7cde2b3640 1 Processor -- start 2024-04-17T02:22:24.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.736+0000 7f7cde2b3640 1 -- start start 2024-04-17T02:22:24.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.737+0000 7f7cde2b3640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7cd80a0580 0x7f7cd81451c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:24.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.737+0000 7f7cde2b3640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cd80a09c0 con 0x7f7cd8145700 2024-04-17T02:22:24.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.737+0000 7f7cde2b3640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cd80a8680 con 0x7f7cd81415d0 2024-04-17T02:22:24.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.737+0000 7f7cde2b3640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f7cd80a5820 con 0x7f7cd80a0580 2024-04-17T02:22:24.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.737+0000 7f7cdc850640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f7cd8145700 0x7f7cd814c550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39866/0 (socket says 172.21.15.17:39866) 2024-04-17T02:22:24.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.737+0000 7f7cdc850640 1 -- 172.21.15.17:0/951634571 learned_addr learned my addr 172.21.15.17:0/951634571 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:22:24.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.737+0000 7f7ccffff640 1 --2- 172.21.15.17:0/951634571 >> v2:172.21.15.122:3300/0 conn(0x7f7cd80a0580 0x7f7cd81451c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:24.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.737+0000 7f7cd77fe640 1 -- 172.21.15.17:0/951634571 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2881212421 0 0) 0x7f7cd0001490 con 0x7f7cd8145700 2024-04-17T02:22:24.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.737+0000 7f7cd77fe640 1 -- 172.21.15.17:0/951634571 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cc4003520 con 0x7f7cd8145700 2024-04-17T02:22:24.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.737+0000 7f7cd77fe640 1 -- 172.21.15.17:0/951634571 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3683823634 0 0) 0x7f7cc4003520 con 0x7f7cd8145700 2024-04-17T02:22:24.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.737+0000 7f7cd77fe640 1 -- 172.21.15.17:0/951634571 >> v2:172.21.15.122:3300/0 conn(0x7f7cd80a0580 msgr2=0x7f7cd81451c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:24.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.737+0000 7f7cd77fe640 1 --2- 172.21.15.17:0/951634571 >> v2:172.21.15.122:3300/0 conn(0x7f7cd80a0580 0x7f7cd81451c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:24.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.737+0000 7f7cd77fe640 1 -- 172.21.15.17:0/951634571 >> v1:172.21.15.122:6789/0 conn(0x7f7cd81415d0 legacy=0x7f7cd80a7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:24.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.737+0000 7f7cd77fe640 1 -- 172.21.15.17:0/951634571 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd8145d40 con 0x7f7cd8145700 2024-04-17T02:22:24.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.737+0000 7f7cd77fe640 1 -- 172.21.15.17:0/951634571 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1752030744 0 0) 0x7f7cd0001bc0 con 0x7f7cd8145700 2024-04-17T02:22:24.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.737+0000 7f7cd77fe640 1 -- 172.21.15.17:0/951634571 >> v1:172.21.15.17:6789/0 conn(0x7f7cd8145700 legacy=0x7f7cd814c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:24.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.737+0000 7f7cd77fe640 1 --2- 172.21.15.17:0/951634571 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cc40039b0 0x7f7cc4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:24.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.737+0000 7f7cd77fe640 1 --2- 172.21.15.17:0/951634571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cc4004800 0x7f7cc4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:24.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.737+0000 7f7cd77fe640 1 --2- 172.21.15.17:0/951634571 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cc40052e0 0x7f7cc400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:24.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.737+0000 7f7cd77fe640 1 -- 172.21.15.17:0/951634571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd80a5820 con 0x7f7cc4004800 2024-04-17T02:22:24.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.737+0000 7f7cd77fe640 1 -- 172.21.15.17:0/951634571 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc400c1b0 con 0x7f7cc40039b0 2024-04-17T02:22:24.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.737+0000 7f7cd77fe640 1 -- 172.21.15.17:0/951634571 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f7cc400c3b0 con 0x7f7cc40052e0 2024-04-17T02:22:24.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.738+0000 7f7ccffff640 1 --2- 172.21.15.17:0/951634571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cc4004800 0x7f7cc4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:24.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.738+0000 7f7cdc850640 1 --2- 172.21.15.17:0/951634571 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cc40052e0 0x7f7cc400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:24.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.738+0000 7f7cd7fff640 1 --2- 172.21.15.17:0/951634571 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cc40039b0 0x7f7cc4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:24.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.738+0000 7f7ccffff640 1 -- 172.21.15.17:0/951634571 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cc40052e0 msgr2=0x7f7cc400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:24.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.738+0000 7f7ccffff640 1 --2- 172.21.15.17:0/951634571 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cc40052e0 0x7f7cc400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:24.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.738+0000 7f7ccffff640 1 -- 172.21.15.17:0/951634571 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cc40039b0 msgr2=0x7f7cc4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:24.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.738+0000 7f7ccffff640 1 --2- 172.21.15.17:0/951634571 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cc40039b0 0x7f7cc4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:24.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.738+0000 7f7ccffff640 1 -- 172.21.15.17:0/951634571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc4003520 con 0x7f7cc4004800 2024-04-17T02:22:24.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.738+0000 7f7cdc850640 1 -- 172.21.15.17:0/951634571 reap_dead start 2024-04-17T02:22:24.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.739+0000 7f7ccffff640 1 --2- 172.21.15.17:0/951634571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cc4004800 0x7f7cc4004c80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0009a90 tx=0x7f7cc4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=936a9bab2a7be32f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:24.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.739+0000 7f7cd77fe640 1 -- 172.21.15.17:0/951634571 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0039070 con 0x7f7cc4004800 2024-04-17T02:22:24.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.739+0000 7f7cd77fe640 1 -- 172.21.15.17:0/951634571 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cc002c680 con 0x7f7cc4004800 2024-04-17T02:22:24.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.739+0000 7f7cd77fe640 1 -- 172.21.15.17:0/951634571 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0009690 con 0x7f7cc4004800 2024-04-17T02:22:24.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.739+0000 7f7cde2b3640 1 -- 172.21.15.17:0/951634571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cc4004800 msgr2=0x7f7cc4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:24.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.739+0000 7f7cde2b3640 1 --2- 172.21.15.17:0/951634571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cc4004800 0x7f7cc4004c80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0009a90 tx=0x7f7cc4005830 comp rx=0 tx=0).stop 2024-04-17T02:22:24.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.739+0000 7f7cde2b3640 1 -- 172.21.15.17:0/951634571 shutdown_connections 2024-04-17T02:22:24.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.739+0000 7f7cde2b3640 1 --2- 172.21.15.17:0/951634571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cc4004800 0x7f7cc4004c80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:24.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.739+0000 7f7cde2b3640 1 -- 172.21.15.17:0/951634571 >> 172.21.15.17:0/951634571 conn(0x7f7cd80748d0 msgr2=0x7f7cd80a59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:24.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.739+0000 7f7cde2b3640 1 -- 172.21.15.17:0/951634571 shutdown_connections 2024-04-17T02:22:24.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.739+0000 7f7cde2b3640 1 -- 172.21.15.17:0/951634571 wait complete. 2024-04-17T02:22:24.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.740+0000 7f7cde2b3640 1 Processor -- start 2024-04-17T02:22:24.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.740+0000 7f7cde2b3640 1 -- start start 2024-04-17T02:22:24.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.741+0000 7f7cde2b3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cc4004800 0x7f7cd8144a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:24.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.741+0000 7f7cde2b3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cd8072570 0x7f7cd813c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.741+0000 7f7cde2b3640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cd8072990 0x7f7cd813c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.741+0000 7f7cde2b3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd81419b0 con 0x7f7cc4004800 2024-04-17T02:22:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.741+0000 7f7cde2b3640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd80a0bc0 con 0x7f7cd8072570 2024-04-17T02:22:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.741+0000 7f7cde2b3640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f7cd80a4eb0 con 0x7f7cd8072990 2024-04-17T02:22:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.741+0000 7f7cd7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cc4004800 0x7f7cd8144a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.741+0000 7f7cd7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cc4004800 0x7f7cd8144a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44538/0 (socket says 172.21.15.17:44538) 2024-04-17T02:22:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.741+0000 7f7cd7fff640 1 -- 172.21.15.17:0/2788093901 learned_addr learned my addr 172.21.15.17:0/2788093901 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.741+0000 7f7cdc850640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cd8072990 0x7f7cd813c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.741+0000 7f7ccffff640 1 --2- 172.21.15.17:0/2788093901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cd8072570 0x7f7cd813c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.741+0000 7f7cd7fff640 1 -- 172.21.15.17:0/2788093901 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cd8072990 msgr2=0x7f7cd813c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.741+0000 7f7cd7fff640 1 --2- 172.21.15.17:0/2788093901 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cd8072990 0x7f7cd813c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.741+0000 7f7cd7fff640 1 -- 172.21.15.17:0/2788093901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cd8072570 msgr2=0x7f7cd813c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.741+0000 7f7cd7fff640 1 --2- 172.21.15.17:0/2788093901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cd8072570 0x7f7cd813c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.741+0000 7f7cd7fff640 1 -- 172.21.15.17:0/2788093901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd80b5c80 con 0x7f7cc4004800 2024-04-17T02:22:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.741+0000 7f7cd7fff640 1 --2- 172.21.15.17:0/2788093901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cc4004800 0x7f7cd8144a50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7cc800f620 tx=0x7f7cc800fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.741+0000 7f7cd57fa640 1 -- 172.21.15.17:0/2788093901 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc80052e0 con 0x7f7cc4004800 2024-04-17T02:22:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.742+0000 7f7cd57fa640 1 -- 172.21.15.17:0/2788093901 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cc8018070 con 0x7f7cc4004800 2024-04-17T02:22:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.742+0000 7f7cde2b3640 1 -- 172.21.15.17:0/2788093901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cd8072ef0 con 0x7f7cc4004800 2024-04-17T02:22:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.742+0000 7f7cd57fa640 1 -- 172.21.15.17:0/2788093901 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc8003810 con 0x7f7cc4004800 2024-04-17T02:22:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.742+0000 7f7cde2b3640 1 -- 172.21.15.17:0/2788093901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cd813cd20 con 0x7f7cc4004800 2024-04-17T02:22:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.742+0000 7f7cde2b3640 1 -- 172.21.15.17:0/2788093901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cd80687f0 con 0x7f7cc4004800 2024-04-17T02:22:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.744+0000 7f7cd57fa640 1 -- 172.21.15.17:0/2788093901 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f7cc80039b0 con 0x7f7cc4004800 2024-04-17T02:22:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.744+0000 7f7cd57fa640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.745+0000 7f7cd57fa640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.745+0000 7f7cd57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.745+0000 7f7cd57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.745+0000 7f7cd57fa640 1 --2- 172.21.15.17:0/2788093901 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f7cb809f480 0x7f7cb80a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.745+0000 7f7ccffff640 1 --2- 172.21.15.17:0/2788093901 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f7cb809f480 0x7f7cb80a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.745+0000 7f7cd57fa640 1 -- 172.21.15.17:0/2788093901 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f7cc80c9bf0 con 0x7f7cc4004800 2024-04-17T02:22:24.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.745+0000 7f7ccffff640 1 --2- 172.21.15.17:0/2788093901 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f7cb809f480 0x7f7cb80a1940 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0036000 tx=0x7f7cc0030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:24.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.748+0000 7f7cd57fa640 1 -- 172.21.15.17:0/2788093901 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f7cc8098c50 con 0x7f7cc4004800 2024-04-17T02:22:24.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.931+0000 7f7cde2b3640 1 -- 172.21.15.17:0/2788093901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7cd80a2500 con 0x7f7cc4004800 2024-04-17T02:22:24.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.932+0000 7f7cd57fa640 1 -- 172.21.15.17:0/2788093901 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+13561 (secure 0 0 0) 0x7f7cc8098550 con 0x7f7cc4004800 2024-04-17T02:22:24.933 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:22:24.933 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":20,"fsid":"7cbfae20-b10d-41da-92b7-cbd5c1632e23","created":"2024-04-17T02:22:00.246446+0000","modified":"2024-04-17T02:22:23.241120+0000","last_up_change":"2024-04-17T02:22:09.077928+0000","last_in_change":"2024-04-17T02:22:01.415384+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T02:22:10.533377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-17T02:22:15.947495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-17T02:22:20.016616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-17T02:22:20.573938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2973665c-6c5e-4688-bffe-72d3bdcf467f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6801","nonce":1828284343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6803","nonce":1828284343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6807","nonce":1828284343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6805","nonce":1828284343}]},"public_addr":"172.21.15.17:6801/1828284343","cluster_addr":"172.21.15.17:6803/1828284343","heartbeat_back_addr":"172.21.15.17:6807/1828284343","heartbeat_front_addr":"172.21.15.17:6805/1828284343","state":["exists","up"]},{"osd":1,"uuid":"a59a034d-19b4-47e8-8ca5-538597b4af1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6809","nonce":2064593011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6811","nonce":2064593011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6815","nonce":2064593011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6813","nonce":2064593011}]},"public_addr":"172.21.15.122:6809/2064593011","cluster_addr":"172.21.15.122:6811/2064593011","heartbeat_back_addr":"172.21.15.122:6815/2064593011","heartbeat_front_addr":"172.21.15.122:6813/2064593011","state":["exists","up"]},{"osd":2,"uuid":"070f4c5f-459f-46ff-b980-05b1ac50c951","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6817","nonce":929092547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6819","nonce":929092547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6823","nonce":929092547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6821","nonce":929092547}]},"public_addr":"172.21.15.122:6817/929092547","cluster_addr":"172.21.15.122:6819/929092547","heartbeat_back_addr":"172.21.15.122:6823/929092547","heartbeat_front_addr":"172.21.15.122:6821/929092547","state":["exists","up"]},{"osd":3,"uuid":"96216a49-a7b6-40eb-bc93-cc8c78a5270a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6801","nonce":204132523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6803","nonce":204132523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6807","nonce":204132523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6805","nonce":204132523}]},"public_addr":"172.21.15.122:6801/204132523","cluster_addr":"172.21.15.122:6803/204132523","heartbeat_back_addr":"172.21.15.122:6807/204132523","heartbeat_front_addr":"172.21.15.122:6805/204132523","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.477173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.522791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.590625+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.480698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T02:22:24.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.934+0000 7f7cde2b3640 10 mgrc shutdown 2024-04-17T02:22:24.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.934+0000 7f7cde2b3640 1 -- 172.21.15.17:0/2788093901 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f7cb809f480 msgr2=0x7f7cb80a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:24.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.934+0000 7f7cde2b3640 1 --2- 172.21.15.17:0/2788093901 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f7cb809f480 0x7f7cb80a1940 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0036000 tx=0x7f7cc0030000 comp rx=0 tx=0).stop 2024-04-17T02:22:24.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.934+0000 7f7cde2b3640 1 -- 172.21.15.17:0/2788093901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cc4004800 msgr2=0x7f7cd8144a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:24.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.934+0000 7f7cde2b3640 1 --2- 172.21.15.17:0/2788093901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cc4004800 0x7f7cd8144a50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7cc800f620 tx=0x7f7cc800fae0 comp rx=0 tx=0).stop 2024-04-17T02:22:24.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.934+0000 7f7cde2b3640 1 -- 172.21.15.17:0/2788093901 shutdown_connections 2024-04-17T02:22:24.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.934+0000 7f7cde2b3640 1 --2- 172.21.15.17:0/2788093901 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f7cb809f480 0x7f7cb80a1940 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:24.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.934+0000 7f7cde2b3640 1 --2- 172.21.15.17:0/2788093901 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f7cd8072990 0x7f7cd813c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:24.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.934+0000 7f7cde2b3640 1 --2- 172.21.15.17:0/2788093901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cd8072570 0x7f7cd813c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:24.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.934+0000 7f7cde2b3640 1 --2- 172.21.15.17:0/2788093901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cc4004800 0x7f7cd8144a50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:24.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.934+0000 7f7cde2b3640 1 -- 172.21.15.17:0/2788093901 >> 172.21.15.17:0/2788093901 conn(0x7f7cd80748d0 msgr2=0x7f7cd80a1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:24.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.934+0000 7f7cde2b3640 1 -- 172.21.15.17:0/2788093901 shutdown_connections 2024-04-17T02:22:24.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:24.934+0000 7f7cde2b3640 1 -- 172.21.15.17:0/2788093901 wait complete. 2024-04-17T02:22:24.946 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-17T02:22:24.947 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T02:22:25.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.049+0000 7f2b9493d640 1 Processor -- start 2024-04-17T02:22:25.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.049+0000 7f2b9493d640 1 -- start start 2024-04-17T02:22:25.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.050+0000 7f2b9493d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f2b900ab5b0 0x7f2b900ac680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:25.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.050+0000 7f2b9493d640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f2b90142c90 0x7f2b9014fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:25.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.050+0000 7f2b9493d640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b900acea0 con 0x7f2b900bb460 2024-04-17T02:22:25.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.050+0000 7f2b9493d640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f2b900ab990 con 0x7f2b900ab5b0 2024-04-17T02:22:25.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.050+0000 7f2b9493d640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f2b9006c330 con 0x7f2b90142c90 2024-04-17T02:22:25.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.050+0000 7f2b8ed9d640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f2b90142c90 0x7f2b9014fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:25.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.050+0000 7f2b8ed9d640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f2b90142c90 0x7f2b9014fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:58024/0 (socket says 172.21.15.17:58024) 2024-04-17T02:22:25.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.050+0000 7f2b8ed9d640 1 -- 172.21.15.17:0/2253177748 learned_addr learned my addr 172.21.15.17:0/2253177748 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:25.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.050+0000 7f2b8e59c640 1 --2- 172.21.15.17:0/2253177748 >> v2:172.21.15.122:3300/0 conn(0x7f2b900ab5b0 0x7f2b900ac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:25.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.050+0000 7f2b8ed9d640 1 -- 172.21.15.17:0/2253177748 >> v2:172.21.15.122:3300/0 conn(0x7f2b900ab5b0 msgr2=0x7f2b900ac680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:25.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.050+0000 7f2b8ed9d640 1 --2- 172.21.15.17:0/2253177748 >> v2:172.21.15.122:3300/0 conn(0x7f2b900ab5b0 0x7f2b900ac680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:25.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.050+0000 7f2b8ed9d640 1 -- 172.21.15.17:0/2253177748 >> v1:172.21.15.122:6789/0 conn(0x7f2b900bb460 legacy=0x7f2b90142580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:25.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.050+0000 7f2b8ed9d640 1 -- 172.21.15.17:0/2253177748 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b900acbc0 con 0x7f2b90142c90 2024-04-17T02:22:25.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.050+0000 7f2b8e59c640 1 --2- 172.21.15.17:0/2253177748 >> v2:172.21.15.122:3300/0 conn(0x7f2b900ab5b0 0x7f2b900ac680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T02:22:25.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.051+0000 7f2b8ed9d640 1 --2- 172.21.15.17:0/2253177748 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f2b90142c90 0x7f2b9014fa90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2b80009e50 tx=0x7f2b8002bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c86c7b1af25dc4e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:25.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.051+0000 7f2b8d59a640 1 -- 172.21.15.17:0/2253177748 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8002ca70 con 0x7f2b90142c90 2024-04-17T02:22:25.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.051+0000 7f2b8d59a640 1 -- 172.21.15.17:0/2253177748 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b8002cc10 con 0x7f2b90142c90 2024-04-17T02:22:25.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.051+0000 7f2b8d59a640 1 -- 172.21.15.17:0/2253177748 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b800343f0 con 0x7f2b90142c90 2024-04-17T02:22:25.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.052+0000 7f2b9493d640 1 -- 172.21.15.17:0/2253177748 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f2b90142c90 msgr2=0x7f2b9014fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:25.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.052+0000 7f2b9493d640 1 --2- 172.21.15.17:0/2253177748 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f2b90142c90 0x7f2b9014fa90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2b80009e50 tx=0x7f2b8002bed0 comp rx=0 tx=0).stop 2024-04-17T02:22:25.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.052+0000 7f2b9493d640 1 -- 172.21.15.17:0/2253177748 shutdown_connections 2024-04-17T02:22:25.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.052+0000 7f2b9493d640 1 --2- 172.21.15.17:0/2253177748 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f2b90142c90 0x7f2b9014fa90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:25.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.052+0000 7f2b9493d640 1 --2- 172.21.15.17:0/2253177748 >> v2:172.21.15.122:3300/0 conn(0x7f2b900ab5b0 0x7f2b900ac680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:25.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.052+0000 7f2b9493d640 1 -- 172.21.15.17:0/2253177748 >> 172.21.15.17:0/2253177748 conn(0x7f2b900ba940 msgr2=0x7f2b900bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:25.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.052+0000 7f2b9493d640 1 -- 172.21.15.17:0/2253177748 shutdown_connections 2024-04-17T02:22:25.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.052+0000 7f2b9493d640 1 -- 172.21.15.17:0/2253177748 wait complete. 2024-04-17T02:22:25.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.053+0000 7f2b9493d640 1 Processor -- start 2024-04-17T02:22:25.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.053+0000 7f2b9493d640 1 -- start start 2024-04-17T02:22:25.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.054+0000 7f2b9493d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b900ab5b0 0x7f2b900b9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:25.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.054+0000 7f2b9493d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b900bb460 0x7f2b90146560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:25.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.054+0000 7f2b9493d640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f2b90142c90 0x7f2b90146aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:25.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.054+0000 7f2b9493d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2b900a9700 con 0x7f2b900bb460 2024-04-17T02:22:25.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.054+0000 7f2b9493d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2b900a7400 con 0x7f2b900ab5b0 2024-04-17T02:22:25.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.054+0000 7f2b9493d640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f2b900a9880 con 0x7f2b90142c90 2024-04-17T02:22:25.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.054+0000 7f2b8ed9d640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f2b90142c90 0x7f2b90146aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:25.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.054+0000 7f2b8dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b900bb460 0x7f2b90146560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:25.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.054+0000 7f2b8ed9d640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f2b90142c90 0x7f2b90146aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:58034/0 (socket says 172.21.15.17:58034) 2024-04-17T02:22:25.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.054+0000 7f2b8dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b900bb460 0x7f2b90146560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44546/0 (socket says 172.21.15.17:44546) 2024-04-17T02:22:25.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.054+0000 7f2b8ed9d640 1 -- 172.21.15.17:0/4237851582 learned_addr learned my addr 172.21.15.17:0/4237851582 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:25.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.054+0000 7f2b8e59c640 1 --2- 172.21.15.17:0/4237851582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b900ab5b0 0x7f2b900b9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:25.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.054+0000 7f2b8ed9d640 1 -- 172.21.15.17:0/4237851582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b900ab5b0 msgr2=0x7f2b900b9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:25.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.054+0000 7f2b8ed9d640 1 --2- 172.21.15.17:0/4237851582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b900ab5b0 0x7f2b900b9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:25.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.054+0000 7f2b8ed9d640 1 -- 172.21.15.17:0/4237851582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b900bb460 msgr2=0x7f2b90146560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:25.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.054+0000 7f2b8ed9d640 1 --2- 172.21.15.17:0/4237851582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b900bb460 0x7f2b90146560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:25.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.054+0000 7f2b8ed9d640 1 -- 172.21.15.17:0/4237851582 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b9009a500 con 0x7f2b90142c90 2024-04-17T02:22:25.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.054+0000 7f2b8e59c640 1 --2- 172.21.15.17:0/4237851582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b900ab5b0 0x7f2b900b9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:25.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.054+0000 7f2b8dd9b640 1 --2- 172.21.15.17:0/4237851582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b900bb460 0x7f2b90146560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:25.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.054+0000 7f2b8ed9d640 1 --2- 172.21.15.17:0/4237851582 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f2b90142c90 0x7f2b90146aa0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2b80036040 tx=0x7f2b80004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:25.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.055+0000 7f2b7effd640 1 -- 172.21.15.17:0/4237851582 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b80044020 con 0x7f2b90142c90 2024-04-17T02:22:25.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.055+0000 7f2b7effd640 1 -- 172.21.15.17:0/4237851582 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b80040690 con 0x7f2b90142c90 2024-04-17T02:22:25.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.055+0000 7f2b9493d640 1 -- 172.21.15.17:0/4237851582 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b90147190 con 0x7f2b90142c90 2024-04-17T02:22:25.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.055+0000 7f2b7effd640 1 -- 172.21.15.17:0/4237851582 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b80009510 con 0x7f2b90142c90 2024-04-17T02:22:25.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.055+0000 7f2b9493d640 1 -- 172.21.15.17:0/4237851582 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b900ba570 con 0x7f2b90142c90 2024-04-17T02:22:25.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.056+0000 7f2b9493d640 1 -- 172.21.15.17:0/4237851582 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b900687f0 con 0x7f2b90142c90 2024-04-17T02:22:25.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.057+0000 7f2b7effd640 1 -- 172.21.15.17:0/4237851582 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f2b80047020 con 0x7f2b90142c90 2024-04-17T02:22:25.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.057+0000 7f2b7effd640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:25.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.057+0000 7f2b7effd640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:25.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.057+0000 7f2b7effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:25.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.057+0000 7f2b7effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:25.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.057+0000 7f2b7effd640 1 --2- 172.21.15.17:0/4237851582 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f2b7009f400 0x7f2b700a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:25.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.057+0000 7f2b8e59c640 1 --2- 172.21.15.17:0/4237851582 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f2b7009f400 0x7f2b700a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:25.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.057+0000 7f2b7effd640 1 -- 172.21.15.17:0/4237851582 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f2b800ebf70 con 0x7f2b90142c90 2024-04-17T02:22:25.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.058+0000 7f2b8e59c640 1 --2- 172.21.15.17:0/4237851582 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f2b7009f400 0x7f2b700a18c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800af30 tx=0x7f2b88008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:25.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.061+0000 7f2b7effd640 1 -- 172.21.15.17:0/4237851582 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f2b8004e030 con 0x7f2b90142c90 2024-04-17T02:22:25.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.239+0000 7f2b9493d640 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2024-04-17T02:22:25.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.239+0000 7f2b9493d640 1 -- 172.21.15.17:0/4237851582 --> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2b9006c110 con 0x7f2b7009f400 2024-04-17T02:22:25.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.245+0000 7f2b7effd640 1 -- 172.21.15.17:0/4237851582 <== mgr.4103 v2:172.21.15.17:6808/563692809 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+255669 (secure 0 0 0) 0x7f2b9006c110 con 0x7f2b7009f400 2024-04-17T02:22:25.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.245+0000 7f2b7effd640 20 mgrc handle_command_reply tid 0 r 0 2024-04-17T02:22:25.250 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:22:25.251 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-04-17T02:22:25.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.248+0000 7f2b9493d640 10 mgrc shutdown 2024-04-17T02:22:25.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.248+0000 7f2b9493d640 1 -- 172.21.15.17:0/4237851582 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f2b7009f400 msgr2=0x7f2b700a18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:25.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.248+0000 7f2b9493d640 1 --2- 172.21.15.17:0/4237851582 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f2b7009f400 0x7f2b700a18c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800af30 tx=0x7f2b88008040 comp rx=0 tx=0).stop 2024-04-17T02:22:25.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.248+0000 7f2b9493d640 1 -- 172.21.15.17:0/4237851582 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f2b90142c90 msgr2=0x7f2b90146aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:25.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.248+0000 7f2b9493d640 1 --2- 172.21.15.17:0/4237851582 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f2b90142c90 0x7f2b90146aa0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2b80036040 tx=0x7f2b80004a40 comp rx=0 tx=0).stop 2024-04-17T02:22:25.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.248+0000 7f2b9493d640 1 -- 172.21.15.17:0/4237851582 shutdown_connections 2024-04-17T02:22:25.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.248+0000 7f2b9493d640 1 --2- 172.21.15.17:0/4237851582 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f2b7009f400 0x7f2b700a18c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:25.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.248+0000 7f2b9493d640 1 --2- 172.21.15.17:0/4237851582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b900bb460 0x7f2b90146560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:25.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.248+0000 7f2b9493d640 1 --2- 172.21.15.17:0/4237851582 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f2b90142c90 0x7f2b90146aa0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:25.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.248+0000 7f2b9493d640 1 --2- 172.21.15.17:0/4237851582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b900ab5b0 0x7f2b900b9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:25.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.248+0000 7f2b9493d640 1 -- 172.21.15.17:0/4237851582 >> 172.21.15.17:0/4237851582 conn(0x7f2b900ba940 msgr2=0x7f2b90144a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:25.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.249+0000 7f2b9493d640 1 -- 172.21.15.17:0/4237851582 shutdown_connections 2024-04-17T02:22:25.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.249+0000 7f2b9493d640 1 -- 172.21.15.17:0/4237851582 wait complete. 2024-04-17T02:22:25.263 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-17T02:22:24.504784+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":112928,"kb_used_data":672,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377374432,"statfs":{"total":386547056640,"available":386431418368,"internally_reserved":0,"allocated":688128,"data_stored":1356660,"data_compressed":65024,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":6377,"internal_metadata":114878231},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.269571"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":168,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-17T02:22:18.123829+0000","last_change":"2024-04-17T02:22:12.100529+0000","last_active":"2024-04-17T02:22:18.123829+0000","last_peered":"2024-04-17T02:22:18.123829+0000","last_clean":"2024-04-17T02:22:18.123829+0000","last_became_active":"2024-04-17T02:22:12.100191+0000","last_became_peered":"2024-04-17T02:22:12.100191+0000","last_unstale":"2024-04-17T02:22:18.123829+0000","last_undegraded":"2024-04-17T02:22:18.123829+0000","last_fullsized":"2024-04-17T02:22:18.123829+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:11.088733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:11.088733+0000","last_clean_scrub_stamp":"2024-04-17T02:22:11.088733+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:47:32.959035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-17T02:22:18.123797+0000","last_change":"2024-04-17T02:22:17.123965+0000","last_active":"2024-04-17T02:22:18.123797+0000","last_peered":"2024-04-17T02:22:18.123797+0000","last_clean":"2024-04-17T02:22:18.123797+0000","last_became_active":"2024-04-17T02:22:17.123282+0000","last_became_peered":"2024-04-17T02:22:17.123282+0000","last_unstale":"2024-04-17T02:22:18.123797+0000","last_undegraded":"2024-04-17T02:22:18.123797+0000","last_fullsized":"2024-04-17T02:22:18.123797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:00:54.621590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-17T02:22:18.123928+0000","last_change":"2024-04-17T02:22:17.123918+0000","last_active":"2024-04-17T02:22:18.123928+0000","last_peered":"2024-04-17T02:22:18.123928+0000","last_clean":"2024-04-17T02:22:18.123928+0000","last_became_active":"2024-04-17T02:22:17.123423+0000","last_became_peered":"2024-04-17T02:22:17.123423+0000","last_unstale":"2024-04-17T02:22:18.123928+0000","last_undegraded":"2024-04-17T02:22:18.123928+0000","last_fullsized":"2024-04-17T02:22:18.123928+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:25:53.024970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-17T02:22:18.126195+0000","last_change":"2024-04-17T02:22:17.560526+0000","last_active":"2024-04-17T02:22:18.126195+0000","last_peered":"2024-04-17T02:22:18.126195+0000","last_clean":"2024-04-17T02:22:18.126195+0000","last_became_active":"2024-04-17T02:22:17.560120+0000","last_became_peered":"2024-04-17T02:22:17.560120+0000","last_unstale":"2024-04-17T02:22:18.126195+0000","last_undegraded":"2024-04-17T02:22:18.126195+0000","last_fullsized":"2024-04-17T02:22:18.126195+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:49:30.975553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-17T02:22:18.123873+0000","last_change":"2024-04-17T02:22:17.123761+0000","last_active":"2024-04-17T02:22:18.123873+0000","last_peered":"2024-04-17T02:22:18.123873+0000","last_clean":"2024-04-17T02:22:18.123873+0000","last_became_active":"2024-04-17T02:22:17.123264+0000","last_became_peered":"2024-04-17T02:22:17.123264+0000","last_unstale":"2024-04-17T02:22:18.123873+0000","last_undegraded":"2024-04-17T02:22:18.123873+0000","last_fullsized":"2024-04-17T02:22:18.123873+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:51:28.918451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-17T02:22:18.123989+0000","last_change":"2024-04-17T02:22:17.560478+0000","last_active":"2024-04-17T02:22:18.123989+0000","last_peered":"2024-04-17T02:22:18.123989+0000","last_clean":"2024-04-17T02:22:18.123989+0000","last_became_active":"2024-04-17T02:22:17.560133+0000","last_became_peered":"2024-04-17T02:22:17.560133+0000","last_unstale":"2024-04-17T02:22:18.123989+0000","last_undegraded":"2024-04-17T02:22:18.123989+0000","last_fullsized":"2024-04-17T02:22:18.123989+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:36:01.410663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-17T02:22:18.123812+0000","last_change":"2024-04-17T02:22:17.124496+0000","last_active":"2024-04-17T02:22:18.123812+0000","last_peered":"2024-04-17T02:22:18.123812+0000","last_clean":"2024-04-17T02:22:18.123812+0000","last_became_active":"2024-04-17T02:22:17.123440+0000","last_became_peered":"2024-04-17T02:22:17.123440+0000","last_unstale":"2024-04-17T02:22:18.123812+0000","last_undegraded":"2024-04-17T02:22:18.123812+0000","last_fullsized":"2024-04-17T02:22:18.123812+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:29:11.971454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-17T02:22:18.123989+0000","last_change":"2024-04-17T02:22:17.121783+0000","last_active":"2024-04-17T02:22:18.123989+0000","last_peered":"2024-04-17T02:22:18.123989+0000","last_clean":"2024-04-17T02:22:18.123989+0000","last_became_active":"2024-04-17T02:22:17.121502+0000","last_became_peered":"2024-04-17T02:22:17.121502+0000","last_unstale":"2024-04-17T02:22:18.123989+0000","last_undegraded":"2024-04-17T02:22:18.123989+0000","last_fullsized":"2024-04-17T02:22:18.123989+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:05:41.795170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-17T02:22:18.123811+0000","last_change":"2024-04-17T02:22:17.123744+0000","last_active":"2024-04-17T02:22:18.123811+0000","last_peered":"2024-04-17T02:22:18.123811+0000","last_clean":"2024-04-17T02:22:18.123811+0000","last_became_active":"2024-04-17T02:22:17.123322+0000","last_became_peered":"2024-04-17T02:22:17.123322+0000","last_unstale":"2024-04-17T02:22:18.123811+0000","last_undegraded":"2024-04-17T02:22:18.123811+0000","last_fullsized":"2024-04-17T02:22:18.123811+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:36:41.743830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65024,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":139264,"data_stored":43981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":634349,"data_compressed":32512,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":634349,"data_compressed":32512,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31316,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340524,"statfs":{"total":96636764160,"available":96604696576,"internally_reserved":0,"allocated":139264,"data_stored":43981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32512,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32512,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T02:22:25.268 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T02:22:25.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.406+0000 7f98048ba640 1 Processor -- start 2024-04-17T02:22:25.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.406+0000 7f98048ba640 1 -- start start 2024-04-17T02:22:25.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.406+0000 7f98048ba640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f98000ab3b0 0x7f98000ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:25.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.406+0000 7f98048ba640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f98000acce0 0x7f980014f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:25.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.406+0000 7f98048ba640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98000a7f00 con 0x7f98000a9560 2024-04-17T02:22:25.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.406+0000 7f98048ba640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f98000abd20 con 0x7f98000acce0 2024-04-17T02:22:25.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.406+0000 7f98048ba640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f98000ac000 con 0x7f98000ab3b0 2024-04-17T02:22:25.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.407+0000 7f97fed9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f98000acce0 0x7f980014f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:25.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.407+0000 7f97fe59c640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f98000ab3b0 0x7f98000ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:25.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.407+0000 7f97f5d9b640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f98000a9560 0x7f9800145730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39870/0 (socket says 172.21.15.17:39870) 2024-04-17T02:22:25.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.407+0000 7f97f5d9b640 1 -- 172.21.15.17:0/618217356 learned_addr learned my addr 172.21.15.17:0/618217356 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:22:25.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.407+0000 7f97fe59c640 1 -- 172.21.15.17:0/618217356 >> v2:172.21.15.17:3300/0 conn(0x7f98000acce0 msgr2=0x7f980014f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:25.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.407+0000 7f97fe59c640 1 --2- 172.21.15.17:0/618217356 >> v2:172.21.15.17:3300/0 conn(0x7f98000acce0 0x7f980014f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:25.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.407+0000 7f97fe59c640 1 -- 172.21.15.17:0/618217356 >> v1:172.21.15.17:6789/0 conn(0x7f98000a9560 legacy=0x7f9800145730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:25.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.407+0000 7f97fe59c640 1 -- 172.21.15.17:0/618217356 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98000a7960 con 0x7f98000ab3b0 2024-04-17T02:22:25.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.407+0000 7f97fed9d640 1 --2- 172.21.15.17:0/618217356 >> v2:172.21.15.17:3300/0 conn(0x7f98000acce0 0x7f980014f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:25.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.408+0000 7f97fe59c640 1 --2- 172.21.15.17:0/618217356 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f98000ab3b0 0x7f98000ac7a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f97f00097a0 tx=0x7f97f002b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7c092be28c4b03e server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:25.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.408+0000 7f97fdd9b640 1 -- 172.21.15.17:0/618217356 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f0031780 con 0x7f98000ab3b0 2024-04-17T02:22:25.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.408+0000 7f97fdd9b640 1 -- 172.21.15.17:0/618217356 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97f0037070 con 0x7f98000ab3b0 2024-04-17T02:22:25.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.408+0000 7f97fdd9b640 1 -- 172.21.15.17:0/618217356 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f0031b40 con 0x7f98000ab3b0 2024-04-17T02:22:25.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.408+0000 7f98048ba640 1 -- 172.21.15.17:0/618217356 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f98000ab3b0 msgr2=0x7f98000ac7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:25.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.408+0000 7f98048ba640 1 --2- 172.21.15.17:0/618217356 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f98000ab3b0 0x7f98000ac7a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f97f00097a0 tx=0x7f97f002b820 comp rx=0 tx=0).stop 2024-04-17T02:22:25.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.408+0000 7f98048ba640 1 -- 172.21.15.17:0/618217356 shutdown_connections 2024-04-17T02:22:25.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.408+0000 7f98048ba640 1 --2- 172.21.15.17:0/618217356 >> v2:172.21.15.17:3300/0 conn(0x7f98000acce0 0x7f980014f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:25.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.408+0000 7f98048ba640 1 --2- 172.21.15.17:0/618217356 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f98000ab3b0 0x7f98000ac7a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:25.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.408+0000 7f98048ba640 1 -- 172.21.15.17:0/618217356 >> 172.21.15.17:0/618217356 conn(0x7f98000a9b60 msgr2=0x7f98000a9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:25.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.408+0000 7f98048ba640 1 -- 172.21.15.17:0/618217356 shutdown_connections 2024-04-17T02:22:25.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.408+0000 7f98048ba640 1 -- 172.21.15.17:0/618217356 wait complete. 2024-04-17T02:22:25.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.410+0000 7f98048ba640 1 Processor -- start 2024-04-17T02:22:25.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.410+0000 7f98048ba640 1 -- start start 2024-04-17T02:22:25.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.410+0000 7f98048ba640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98000a9560 0x7f98000ae250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:25.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.410+0000 7f98048ba640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98000ab3b0 0x7f98001480c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:25.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.410+0000 7f98048ba640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f98000acce0 0x7f98001dda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:25.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.410+0000 7f98048ba640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f980006b5b0 con 0x7f98000ab3b0 2024-04-17T02:22:25.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.410+0000 7f98048ba640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9800145e40 con 0x7f98000a9560 2024-04-17T02:22:25.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.410+0000 7f98048ba640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f98001de1a0 con 0x7f98000acce0 2024-04-17T02:22:25.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.410+0000 7f97f5d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98000ab3b0 0x7f98001480c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:25.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.410+0000 7f97fed9d640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f98000acce0 0x7f98001dda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:25.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.410+0000 7f97fed9d640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f98000acce0 0x7f98001dda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:58042/0 (socket says 172.21.15.17:58042) 2024-04-17T02:22:25.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.410+0000 7f97f5d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98000ab3b0 0x7f98001480c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44578/0 (socket says 172.21.15.17:44578) 2024-04-17T02:22:25.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.410+0000 7f97fed9d640 1 -- 172.21.15.17:0/3626917238 learned_addr learned my addr 172.21.15.17:0/3626917238 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:25.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.410+0000 7f97fe59c640 1 --2- 172.21.15.17:0/3626917238 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98000a9560 0x7f98000ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:25.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.411+0000 7f97f5d9b640 1 -- 172.21.15.17:0/3626917238 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f98000acce0 msgr2=0x7f98001dda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:25.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.411+0000 7f97f5d9b640 1 --2- 172.21.15.17:0/3626917238 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f98000acce0 0x7f98001dda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:25.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.411+0000 7f97f5d9b640 1 -- 172.21.15.17:0/3626917238 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98000a9560 msgr2=0x7f98000ae250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:25.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.411+0000 7f97f5d9b640 1 --2- 172.21.15.17:0/3626917238 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98000a9560 0x7f98000ae250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:25.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.411+0000 7f97f5d9b640 1 -- 172.21.15.17:0/3626917238 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98001de460 con 0x7f98000ab3b0 2024-04-17T02:22:25.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.411+0000 7f97fed9d640 1 --2- 172.21.15.17:0/3626917238 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f98000acce0 0x7f98001dda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:25.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.411+0000 7f97f5d9b640 1 --2- 172.21.15.17:0/3626917238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98000ab3b0 0x7f98001480c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f97e8000f60 tx=0x7f97e800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:25.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.411+0000 7f97f77fe640 1 -- 172.21.15.17:0/3626917238 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e8017070 con 0x7f98000ab3b0 2024-04-17T02:22:25.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.411+0000 7f97f77fe640 1 -- 172.21.15.17:0/3626917238 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97e8005ce0 con 0x7f98000ab3b0 2024-04-17T02:22:25.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.411+0000 7f97f77fe640 1 -- 172.21.15.17:0/3626917238 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e8007310 con 0x7f98000ab3b0 2024-04-17T02:22:25.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.411+0000 7f98048ba640 1 -- 172.21.15.17:0/3626917238 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98001d1ae0 con 0x7f98000ab3b0 2024-04-17T02:22:25.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.411+0000 7f98048ba640 1 -- 172.21.15.17:0/3626917238 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f980013f470 con 0x7f98000ab3b0 2024-04-17T02:22:25.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.412+0000 7f98048ba640 1 -- 172.21.15.17:0/3626917238 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98000687f0 con 0x7f98000ab3b0 2024-04-17T02:22:25.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.413+0000 7f97f77fe640 1 -- 172.21.15.17:0/3626917238 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f97e801a070 con 0x7f98000ab3b0 2024-04-17T02:22:25.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.413+0000 7f97f77fe640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:25.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.414+0000 7f97f77fe640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:25.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.414+0000 7f97f77fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:25.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.414+0000 7f97f77fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:25.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.414+0000 7f97f77fe640 1 --2- 172.21.15.17:0/3626917238 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f97e009f4b0 0x7f97e00a1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:25.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.414+0000 7f97fe59c640 1 --2- 172.21.15.17:0/3626917238 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f97e009f4b0 0x7f97e00a1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:25.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.414+0000 7f97f77fe640 1 -- 172.21.15.17:0/3626917238 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f97e80c87c0 con 0x7f98000ab3b0 2024-04-17T02:22:25.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.414+0000 7f97fe59c640 1 --2- 172.21.15.17:0/3626917238 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f97e009f4b0 0x7f97e00a1970 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f97f0036000 tx=0x7f97f003d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:25.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.418+0000 7f97f77fe640 1 -- 172.21.15.17:0/3626917238 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f97e8097130 con 0x7f98000ab3b0 2024-04-17T02:22:25.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.595+0000 7f98048ba640 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2024-04-17T02:22:25.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.595+0000 7f98048ba640 1 -- 172.21.15.17:0/3626917238 --> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f980006c250 con 0x7f97e009f4b0 2024-04-17T02:22:25.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.601+0000 7f97f77fe640 1 -- 172.21.15.17:0/3626917238 <== mgr.4103 v2:172.21.15.17:6808/563692809 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+255669 (secure 0 0 0) 0x7f980006c250 con 0x7f97e009f4b0 2024-04-17T02:22:25.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.601+0000 7f97f77fe640 20 mgrc handle_command_reply tid 0 r 0 2024-04-17T02:22:25.605 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:22:25.606 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-04-17T02:22:25.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.604+0000 7f98048ba640 10 mgrc shutdown 2024-04-17T02:22:25.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.604+0000 7f98048ba640 1 -- 172.21.15.17:0/3626917238 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f97e009f4b0 msgr2=0x7f97e00a1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:25.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.604+0000 7f98048ba640 1 --2- 172.21.15.17:0/3626917238 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f97e009f4b0 0x7f97e00a1970 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f97f0036000 tx=0x7f97f003d040 comp rx=0 tx=0).stop 2024-04-17T02:22:25.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.604+0000 7f98048ba640 1 -- 172.21.15.17:0/3626917238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98000ab3b0 msgr2=0x7f98001480c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:25.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.604+0000 7f98048ba640 1 --2- 172.21.15.17:0/3626917238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98000ab3b0 0x7f98001480c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f97e8000f60 tx=0x7f97e800c800 comp rx=0 tx=0).stop 2024-04-17T02:22:25.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.604+0000 7f98048ba640 1 -- 172.21.15.17:0/3626917238 shutdown_connections 2024-04-17T02:22:25.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.604+0000 7f98048ba640 1 --2- 172.21.15.17:0/3626917238 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f97e009f4b0 0x7f97e00a1970 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:25.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.604+0000 7f98048ba640 1 --2- 172.21.15.17:0/3626917238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98000ab3b0 0x7f98001480c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:25.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.604+0000 7f98048ba640 1 --2- 172.21.15.17:0/3626917238 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f98000acce0 0x7f98001dda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:25.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.604+0000 7f98048ba640 1 --2- 172.21.15.17:0/3626917238 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98000a9560 0x7f98000ae250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:25.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.604+0000 7f98048ba640 1 -- 172.21.15.17:0/3626917238 >> 172.21.15.17:0/3626917238 conn(0x7f98000a9b60 msgr2=0x7f98000b9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:25.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.604+0000 7f98048ba640 1 -- 172.21.15.17:0/3626917238 shutdown_connections 2024-04-17T02:22:25.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.604+0000 7f98048ba640 1 -- 172.21.15.17:0/3626917238 wait complete. 2024-04-17T02:22:25.616 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-17T02:22:24.504784+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":112928,"kb_used_data":672,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377374432,"statfs":{"total":386547056640,"available":386431418368,"internally_reserved":0,"allocated":688128,"data_stored":1356660,"data_compressed":65024,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":6377,"internal_metadata":114878231},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.269571"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":168,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-17T02:22:18.123829+0000","last_change":"2024-04-17T02:22:12.100529+0000","last_active":"2024-04-17T02:22:18.123829+0000","last_peered":"2024-04-17T02:22:18.123829+0000","last_clean":"2024-04-17T02:22:18.123829+0000","last_became_active":"2024-04-17T02:22:12.100191+0000","last_became_peered":"2024-04-17T02:22:12.100191+0000","last_unstale":"2024-04-17T02:22:18.123829+0000","last_undegraded":"2024-04-17T02:22:18.123829+0000","last_fullsized":"2024-04-17T02:22:18.123829+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:11.088733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:11.088733+0000","last_clean_scrub_stamp":"2024-04-17T02:22:11.088733+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:47:32.959035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-17T02:22:18.123797+0000","last_change":"2024-04-17T02:22:17.123965+0000","last_active":"2024-04-17T02:22:18.123797+0000","last_peered":"2024-04-17T02:22:18.123797+0000","last_clean":"2024-04-17T02:22:18.123797+0000","last_became_active":"2024-04-17T02:22:17.123282+0000","last_became_peered":"2024-04-17T02:22:17.123282+0000","last_unstale":"2024-04-17T02:22:18.123797+0000","last_undegraded":"2024-04-17T02:22:18.123797+0000","last_fullsized":"2024-04-17T02:22:18.123797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:00:54.621590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-17T02:22:18.123928+0000","last_change":"2024-04-17T02:22:17.123918+0000","last_active":"2024-04-17T02:22:18.123928+0000","last_peered":"2024-04-17T02:22:18.123928+0000","last_clean":"2024-04-17T02:22:18.123928+0000","last_became_active":"2024-04-17T02:22:17.123423+0000","last_became_peered":"2024-04-17T02:22:17.123423+0000","last_unstale":"2024-04-17T02:22:18.123928+0000","last_undegraded":"2024-04-17T02:22:18.123928+0000","last_fullsized":"2024-04-17T02:22:18.123928+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:25:53.024970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-17T02:22:18.126195+0000","last_change":"2024-04-17T02:22:17.560526+0000","last_active":"2024-04-17T02:22:18.126195+0000","last_peered":"2024-04-17T02:22:18.126195+0000","last_clean":"2024-04-17T02:22:18.126195+0000","last_became_active":"2024-04-17T02:22:17.560120+0000","last_became_peered":"2024-04-17T02:22:17.560120+0000","last_unstale":"2024-04-17T02:22:18.126195+0000","last_undegraded":"2024-04-17T02:22:18.126195+0000","last_fullsized":"2024-04-17T02:22:18.126195+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:49:30.975553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-17T02:22:18.123873+0000","last_change":"2024-04-17T02:22:17.123761+0000","last_active":"2024-04-17T02:22:18.123873+0000","last_peered":"2024-04-17T02:22:18.123873+0000","last_clean":"2024-04-17T02:22:18.123873+0000","last_became_active":"2024-04-17T02:22:17.123264+0000","last_became_peered":"2024-04-17T02:22:17.123264+0000","last_unstale":"2024-04-17T02:22:18.123873+0000","last_undegraded":"2024-04-17T02:22:18.123873+0000","last_fullsized":"2024-04-17T02:22:18.123873+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:51:28.918451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-17T02:22:18.123989+0000","last_change":"2024-04-17T02:22:17.560478+0000","last_active":"2024-04-17T02:22:18.123989+0000","last_peered":"2024-04-17T02:22:18.123989+0000","last_clean":"2024-04-17T02:22:18.123989+0000","last_became_active":"2024-04-17T02:22:17.560133+0000","last_became_peered":"2024-04-17T02:22:17.560133+0000","last_unstale":"2024-04-17T02:22:18.123989+0000","last_undegraded":"2024-04-17T02:22:18.123989+0000","last_fullsized":"2024-04-17T02:22:18.123989+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:36:01.410663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-17T02:22:18.123812+0000","last_change":"2024-04-17T02:22:17.124496+0000","last_active":"2024-04-17T02:22:18.123812+0000","last_peered":"2024-04-17T02:22:18.123812+0000","last_clean":"2024-04-17T02:22:18.123812+0000","last_became_active":"2024-04-17T02:22:17.123440+0000","last_became_peered":"2024-04-17T02:22:17.123440+0000","last_unstale":"2024-04-17T02:22:18.123812+0000","last_undegraded":"2024-04-17T02:22:18.123812+0000","last_fullsized":"2024-04-17T02:22:18.123812+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:29:11.971454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-17T02:22:18.123989+0000","last_change":"2024-04-17T02:22:17.121783+0000","last_active":"2024-04-17T02:22:18.123989+0000","last_peered":"2024-04-17T02:22:18.123989+0000","last_clean":"2024-04-17T02:22:18.123989+0000","last_became_active":"2024-04-17T02:22:17.121502+0000","last_became_peered":"2024-04-17T02:22:17.121502+0000","last_unstale":"2024-04-17T02:22:18.123989+0000","last_undegraded":"2024-04-17T02:22:18.123989+0000","last_fullsized":"2024-04-17T02:22:18.123989+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:05:41.795170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-17T02:22:18.123811+0000","last_change":"2024-04-17T02:22:17.123744+0000","last_active":"2024-04-17T02:22:18.123811+0000","last_peered":"2024-04-17T02:22:18.123811+0000","last_clean":"2024-04-17T02:22:18.123811+0000","last_became_active":"2024-04-17T02:22:17.123322+0000","last_became_peered":"2024-04-17T02:22:17.123322+0000","last_unstale":"2024-04-17T02:22:18.123811+0000","last_undegraded":"2024-04-17T02:22:18.123811+0000","last_fullsized":"2024-04-17T02:22:18.123811+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:36:41.743830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65024,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":139264,"data_stored":43981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":634349,"data_compressed":32512,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":634349,"data_compressed":32512,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31316,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340524,"statfs":{"total":96636764160,"available":96604696576,"internally_reserved":0,"allocated":139264,"data_stored":43981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32512,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32512,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T02:22:25.624 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T02:22:25.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.760+0000 7fd207e05640 1 Processor -- start 2024-04-17T02:22:25.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.760+0000 7fd207e05640 1 -- start start 2024-04-17T02:22:25.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.761+0000 7fd207e05640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd2000bb460 0x7fd200142580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:25.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.761+0000 7fd207e05640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd200142ac0 0x7fd20014fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:25.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.761+0000 7fd207e05640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2000acea0 con 0x7fd2000ab5b0 2024-04-17T02:22:25.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.761+0000 7fd207e05640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fd2000ab990 con 0x7fd2000bb460 2024-04-17T02:22:25.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.761+0000 7fd207e05640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fd20006c330 con 0x7fd200142ac0 2024-04-17T02:22:25.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.761+0000 7fd2063a2640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd200142ac0 0x7fd20014fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:25.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.761+0000 7fd205ba1640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fd2000ab5b0 0x7fd2000ac680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39882/0 (socket says 172.21.15.17:39882) 2024-04-17T02:22:25.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.761+0000 7fd205ba1640 1 -- 172.21.15.17:0/1243655281 learned_addr learned my addr 172.21.15.17:0/1243655281 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:22:25.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.761+0000 7fd2053a0640 1 --2- 172.21.15.17:0/1243655281 >> v2:172.21.15.122:3300/0 conn(0x7fd2000bb460 0x7fd200142580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:25.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.761+0000 7fd204b9f640 1 -- 172.21.15.17:0/1243655281 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2520408595 0 0) 0x7fd2000acea0 con 0x7fd2000ab5b0 2024-04-17T02:22:25.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.761+0000 7fd2063a2640 1 -- 172.21.15.17:0/1243655281 >> v2:172.21.15.122:3300/0 conn(0x7fd2000bb460 msgr2=0x7fd200142580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:25.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.761+0000 7fd2063a2640 1 --2- 172.21.15.17:0/1243655281 >> v2:172.21.15.122:3300/0 conn(0x7fd2000bb460 0x7fd200142580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:25.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.761+0000 7fd2063a2640 1 -- 172.21.15.17:0/1243655281 >> v1:172.21.15.17:6789/0 conn(0x7fd2000ab5b0 legacy=0x7fd2000ac680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:25.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.761+0000 7fd2063a2640 1 -- 172.21.15.17:0/1243655281 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd20006dd30 con 0x7fd200142ac0 2024-04-17T02:22:25.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.762+0000 7fd2063a2640 1 --2- 172.21.15.17:0/1243655281 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd200142ac0 0x7fd20014fa90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8009d90 tx=0x7fd1f802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf26dce524481c1b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:25.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.762+0000 7fd204b9f640 1 -- 172.21.15.17:0/1243655281 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8039070 con 0x7fd200142ac0 2024-04-17T02:22:25.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.762+0000 7fd204b9f640 1 -- 172.21.15.17:0/1243655281 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1f802cc50 con 0x7fd200142ac0 2024-04-17T02:22:25.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.762+0000 7fd204b9f640 1 -- 172.21.15.17:0/1243655281 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8034440 con 0x7fd200142ac0 2024-04-17T02:22:25.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.763+0000 7fd207e05640 1 -- 172.21.15.17:0/1243655281 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd200142ac0 msgr2=0x7fd20014fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:25.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.763+0000 7fd207e05640 1 --2- 172.21.15.17:0/1243655281 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd200142ac0 0x7fd20014fa90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8009d90 tx=0x7fd1f802bea0 comp rx=0 tx=0).stop 2024-04-17T02:22:25.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.763+0000 7fd207e05640 1 -- 172.21.15.17:0/1243655281 shutdown_connections 2024-04-17T02:22:25.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.763+0000 7fd207e05640 1 --2- 172.21.15.17:0/1243655281 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd200142ac0 0x7fd20014fa90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:25.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.763+0000 7fd207e05640 1 --2- 172.21.15.17:0/1243655281 >> v2:172.21.15.122:3300/0 conn(0x7fd2000bb460 0x7fd200142580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:25.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.763+0000 7fd207e05640 1 -- 172.21.15.17:0/1243655281 >> 172.21.15.17:0/1243655281 conn(0x7fd2000ba940 msgr2=0x7fd2000bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:25.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.763+0000 7fd207e05640 1 -- 172.21.15.17:0/1243655281 shutdown_connections 2024-04-17T02:22:25.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.763+0000 7fd207e05640 1 -- 172.21.15.17:0/1243655281 wait complete. 2024-04-17T02:22:25.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.764+0000 7fd207e05640 1 Processor -- start 2024-04-17T02:22:25.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.764+0000 7fd207e05640 1 -- start start 2024-04-17T02:22:25.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.764+0000 7fd207e05640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2000ab5b0 0x7fd20013cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:25.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.764+0000 7fd207e05640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd2000bb460 0x7fd20013d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:25.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.764+0000 7fd207e05640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd200142ac0 0x7fd20013de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:25.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.765+0000 7fd207e05640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd2000a9880 con 0x7fd200142ac0 2024-04-17T02:22:25.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.765+0000 7fd207e05640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd2000a9700 con 0x7fd2000ab5b0 2024-04-17T02:22:25.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.765+0000 7fd207e05640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fd20014ffd0 con 0x7fd2000bb460 2024-04-17T02:22:25.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.765+0000 7fd2053a0640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd2000bb460 0x7fd20013d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:25.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.765+0000 7fd2063a2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd200142ac0 0x7fd20013de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:25.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.765+0000 7fd2053a0640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd2000bb460 0x7fd20013d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:58058/0 (socket says 172.21.15.17:58058) 2024-04-17T02:22:25.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.765+0000 7fd2063a2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd200142ac0 0x7fd20013de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44594/0 (socket says 172.21.15.17:44594) 2024-04-17T02:22:25.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.765+0000 7fd2053a0640 1 -- 172.21.15.17:0/70316387 learned_addr learned my addr 172.21.15.17:0/70316387 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:25.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.765+0000 7fd205ba1640 1 --2- 172.21.15.17:0/70316387 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2000ab5b0 0x7fd20013cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:25.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.765+0000 7fd2063a2640 1 -- 172.21.15.17:0/70316387 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd2000bb460 msgr2=0x7fd20013d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:25.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.765+0000 7fd2063a2640 1 --2- 172.21.15.17:0/70316387 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd2000bb460 0x7fd20013d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:25.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.765+0000 7fd2063a2640 1 -- 172.21.15.17:0/70316387 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2000ab5b0 msgr2=0x7fd20013cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:25.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.765+0000 7fd2063a2640 1 --2- 172.21.15.17:0/70316387 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2000ab5b0 0x7fd20013cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:25.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.765+0000 7fd2063a2640 1 -- 172.21.15.17:0/70316387 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd200144490 con 0x7fd200142ac0 2024-04-17T02:22:25.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.765+0000 7fd2053a0640 1 --2- 172.21.15.17:0/70316387 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd2000bb460 0x7fd20013d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:25.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.765+0000 7fd2063a2640 1 --2- 172.21.15.17:0/70316387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd200142ac0 0x7fd20013de70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8033000 tx=0x7fd1f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:25.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.765+0000 7fd1f27fc640 1 -- 172.21.15.17:0/70316387 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8039050 con 0x7fd200142ac0 2024-04-17T02:22:25.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.765+0000 7fd1f27fc640 1 -- 172.21.15.17:0/70316387 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1f8045070 con 0x7fd200142ac0 2024-04-17T02:22:25.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.765+0000 7fd207e05640 1 -- 172.21.15.17:0/70316387 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd20013c310 con 0x7fd200142ac0 2024-04-17T02:22:25.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.765+0000 7fd1f27fc640 1 -- 172.21.15.17:0/70316387 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f803e610 con 0x7fd200142ac0 2024-04-17T02:22:25.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.765+0000 7fd207e05640 1 -- 172.21.15.17:0/70316387 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd200143670 con 0x7fd200142ac0 2024-04-17T02:22:25.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.766+0000 7fd207e05640 1 -- 172.21.15.17:0/70316387 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2001426a0 con 0x7fd200142ac0 2024-04-17T02:22:25.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.767+0000 7fd1f27fc640 1 -- 172.21.15.17:0/70316387 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7fd1f803e7b0 con 0x7fd200142ac0 2024-04-17T02:22:25.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.767+0000 7fd1f27fc640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:25.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.768+0000 7fd1f27fc640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:25.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.768+0000 7fd1f27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:25.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.768+0000 7fd1f27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:25.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.768+0000 7fd1f27fc640 1 --2- 172.21.15.17:0/70316387 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fd1e409f480 0x7fd1e40a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:25.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.768+0000 7fd205ba1640 1 --2- 172.21.15.17:0/70316387 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fd1e409f480 0x7fd1e40a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:25.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.768+0000 7fd1f27fc640 1 -- 172.21.15.17:0/70316387 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7fd1f80ecaa0 con 0x7fd200142ac0 2024-04-17T02:22:25.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.768+0000 7fd205ba1640 1 --2- 172.21.15.17:0/70316387 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fd1e409f480 0x7fd1e40a1940 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc000f60 tx=0x7fd1fc007b50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:25.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.771+0000 7fd1f27fc640 1 -- 172.21.15.17:0/70316387 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fd2001426a0 con 0x7fd200142ac0 2024-04-17T02:22:25.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.948+0000 7fd207e05640 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2024-04-17T02:22:25.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.948+0000 7fd207e05640 1 -- 172.21.15.17:0/70316387 --> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd20013eb90 con 0x7fd1e409f480 2024-04-17T02:22:25.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.954+0000 7fd1f27fc640 1 -- 172.21.15.17:0/70316387 <== mgr.4103 v2:172.21.15.17:6808/563692809 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+255669 (secure 0 0 0) 0x7fd20013eb90 con 0x7fd1e409f480 2024-04-17T02:22:25.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.954+0000 7fd1f27fc640 20 mgrc handle_command_reply tid 0 r 0 2024-04-17T02:22:25.958 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:22:25.959 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-04-17T02:22:25.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.957+0000 7fd207e05640 10 mgrc shutdown 2024-04-17T02:22:25.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.957+0000 7fd207e05640 1 -- 172.21.15.17:0/70316387 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fd1e409f480 msgr2=0x7fd1e40a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:25.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.957+0000 7fd207e05640 1 --2- 172.21.15.17:0/70316387 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fd1e409f480 0x7fd1e40a1940 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc000f60 tx=0x7fd1fc007b50 comp rx=0 tx=0).stop 2024-04-17T02:22:25.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.957+0000 7fd207e05640 1 -- 172.21.15.17:0/70316387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd200142ac0 msgr2=0x7fd20013de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:25.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.957+0000 7fd207e05640 1 --2- 172.21.15.17:0/70316387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd200142ac0 0x7fd20013de70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8033000 tx=0x7fd1f8004a40 comp rx=0 tx=0).stop 2024-04-17T02:22:25.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.957+0000 7fd207e05640 1 -- 172.21.15.17:0/70316387 shutdown_connections 2024-04-17T02:22:25.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.957+0000 7fd207e05640 1 --2- 172.21.15.17:0/70316387 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fd1e409f480 0x7fd1e40a1940 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:25.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.957+0000 7fd207e05640 1 --2- 172.21.15.17:0/70316387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd200142ac0 0x7fd20013de70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:25.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.957+0000 7fd207e05640 1 --2- 172.21.15.17:0/70316387 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd2000bb460 0x7fd20013d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:25.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.957+0000 7fd207e05640 1 --2- 172.21.15.17:0/70316387 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2000ab5b0 0x7fd20013cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:25.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.957+0000 7fd207e05640 1 -- 172.21.15.17:0/70316387 >> 172.21.15.17:0/70316387 conn(0x7fd2000ba940 msgr2=0x7fd2000a7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:25.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.957+0000 7fd207e05640 1 -- 172.21.15.17:0/70316387 shutdown_connections 2024-04-17T02:22:25.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:25.957+0000 7fd207e05640 1 -- 172.21.15.17:0/70316387 wait complete. 2024-04-17T02:22:25.969 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-17T02:22:24.504784+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":112928,"kb_used_data":672,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377374432,"statfs":{"total":386547056640,"available":386431418368,"internally_reserved":0,"allocated":688128,"data_stored":1356660,"data_compressed":65024,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":6377,"internal_metadata":114878231},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.269571"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":168,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-17T02:22:18.123829+0000","last_change":"2024-04-17T02:22:12.100529+0000","last_active":"2024-04-17T02:22:18.123829+0000","last_peered":"2024-04-17T02:22:18.123829+0000","last_clean":"2024-04-17T02:22:18.123829+0000","last_became_active":"2024-04-17T02:22:12.100191+0000","last_became_peered":"2024-04-17T02:22:12.100191+0000","last_unstale":"2024-04-17T02:22:18.123829+0000","last_undegraded":"2024-04-17T02:22:18.123829+0000","last_fullsized":"2024-04-17T02:22:18.123829+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:11.088733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:11.088733+0000","last_clean_scrub_stamp":"2024-04-17T02:22:11.088733+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:47:32.959035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-17T02:22:18.123797+0000","last_change":"2024-04-17T02:22:17.123965+0000","last_active":"2024-04-17T02:22:18.123797+0000","last_peered":"2024-04-17T02:22:18.123797+0000","last_clean":"2024-04-17T02:22:18.123797+0000","last_became_active":"2024-04-17T02:22:17.123282+0000","last_became_peered":"2024-04-17T02:22:17.123282+0000","last_unstale":"2024-04-17T02:22:18.123797+0000","last_undegraded":"2024-04-17T02:22:18.123797+0000","last_fullsized":"2024-04-17T02:22:18.123797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:00:54.621590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-17T02:22:18.123928+0000","last_change":"2024-04-17T02:22:17.123918+0000","last_active":"2024-04-17T02:22:18.123928+0000","last_peered":"2024-04-17T02:22:18.123928+0000","last_clean":"2024-04-17T02:22:18.123928+0000","last_became_active":"2024-04-17T02:22:17.123423+0000","last_became_peered":"2024-04-17T02:22:17.123423+0000","last_unstale":"2024-04-17T02:22:18.123928+0000","last_undegraded":"2024-04-17T02:22:18.123928+0000","last_fullsized":"2024-04-17T02:22:18.123928+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:25:53.024970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-17T02:22:18.126195+0000","last_change":"2024-04-17T02:22:17.560526+0000","last_active":"2024-04-17T02:22:18.126195+0000","last_peered":"2024-04-17T02:22:18.126195+0000","last_clean":"2024-04-17T02:22:18.126195+0000","last_became_active":"2024-04-17T02:22:17.560120+0000","last_became_peered":"2024-04-17T02:22:17.560120+0000","last_unstale":"2024-04-17T02:22:18.126195+0000","last_undegraded":"2024-04-17T02:22:18.126195+0000","last_fullsized":"2024-04-17T02:22:18.126195+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:49:30.975553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-17T02:22:18.123873+0000","last_change":"2024-04-17T02:22:17.123761+0000","last_active":"2024-04-17T02:22:18.123873+0000","last_peered":"2024-04-17T02:22:18.123873+0000","last_clean":"2024-04-17T02:22:18.123873+0000","last_became_active":"2024-04-17T02:22:17.123264+0000","last_became_peered":"2024-04-17T02:22:17.123264+0000","last_unstale":"2024-04-17T02:22:18.123873+0000","last_undegraded":"2024-04-17T02:22:18.123873+0000","last_fullsized":"2024-04-17T02:22:18.123873+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:51:28.918451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-17T02:22:18.123989+0000","last_change":"2024-04-17T02:22:17.560478+0000","last_active":"2024-04-17T02:22:18.123989+0000","last_peered":"2024-04-17T02:22:18.123989+0000","last_clean":"2024-04-17T02:22:18.123989+0000","last_became_active":"2024-04-17T02:22:17.560133+0000","last_became_peered":"2024-04-17T02:22:17.560133+0000","last_unstale":"2024-04-17T02:22:18.123989+0000","last_undegraded":"2024-04-17T02:22:18.123989+0000","last_fullsized":"2024-04-17T02:22:18.123989+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:36:01.410663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-17T02:22:18.123812+0000","last_change":"2024-04-17T02:22:17.124496+0000","last_active":"2024-04-17T02:22:18.123812+0000","last_peered":"2024-04-17T02:22:18.123812+0000","last_clean":"2024-04-17T02:22:18.123812+0000","last_became_active":"2024-04-17T02:22:17.123440+0000","last_became_peered":"2024-04-17T02:22:17.123440+0000","last_unstale":"2024-04-17T02:22:18.123812+0000","last_undegraded":"2024-04-17T02:22:18.123812+0000","last_fullsized":"2024-04-17T02:22:18.123812+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:29:11.971454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-17T02:22:18.123989+0000","last_change":"2024-04-17T02:22:17.121783+0000","last_active":"2024-04-17T02:22:18.123989+0000","last_peered":"2024-04-17T02:22:18.123989+0000","last_clean":"2024-04-17T02:22:18.123989+0000","last_became_active":"2024-04-17T02:22:17.121502+0000","last_became_peered":"2024-04-17T02:22:17.121502+0000","last_unstale":"2024-04-17T02:22:18.123989+0000","last_undegraded":"2024-04-17T02:22:18.123989+0000","last_fullsized":"2024-04-17T02:22:18.123989+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:05:41.795170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-17T02:22:18.123811+0000","last_change":"2024-04-17T02:22:17.123744+0000","last_active":"2024-04-17T02:22:18.123811+0000","last_peered":"2024-04-17T02:22:18.123811+0000","last_clean":"2024-04-17T02:22:18.123811+0000","last_became_active":"2024-04-17T02:22:17.123322+0000","last_became_peered":"2024-04-17T02:22:17.123322+0000","last_unstale":"2024-04-17T02:22:18.123811+0000","last_undegraded":"2024-04-17T02:22:18.123811+0000","last_fullsized":"2024-04-17T02:22:18.123811+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:36:41.743830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:21.235005+0000","last_change":"2024-04-17T02:22:21.235005+0000","last_active":"2024-04-17T02:22:21.235005+0000","last_peered":"2024-04-17T02:22:21.235005+0000","last_clean":"2024-04-17T02:22:21.235005+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:21.235005+0000","last_undegraded":"2024-04-17T02:22:21.235005+0000","last_fullsized":"2024-04-17T02:22:21.235005+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-17T02:22:20.233009+0000","last_change":"2024-04-17T02:22:20.233009+0000","last_active":"2024-04-17T02:22:20.233009+0000","last_peered":"2024-04-17T02:22:20.233009+0000","last_clean":"2024-04-17T02:22:20.233009+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-17T02:22:20.233009+0000","last_undegraded":"2024-04-17T02:22:20.233009+0000","last_fullsized":"2024-04-17T02:22:20.233009+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65024,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":139264,"data_stored":43981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":634349,"data_compressed":32512,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":634349,"data_compressed":32512,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31316,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340524,"statfs":{"total":96636764160,"available":96604696576,"internally_reserved":0,"allocated":139264,"data_stored":43981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32512,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32512,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T02:22:25.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3f is not active+clean 2024-04-17T02:22:25.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3e is not active+clean 2024-04-17T02:22:25.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3d is not active+clean 2024-04-17T02:22:25.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3c is not active+clean 2024-04-17T02:22:25.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3b is not active+clean 2024-04-17T02:22:25.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2024-04-17T02:22:25.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2024-04-17T02:22:25.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.38 is not active+clean 2024-04-17T02:22:25.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.37 is not active+clean 2024-04-17T02:22:25.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.36 is not active+clean 2024-04-17T02:22:25.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.35 is not active+clean 2024-04-17T02:22:25.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.34 is not active+clean 2024-04-17T02:22:25.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.33 is not active+clean 2024-04-17T02:22:25.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.32 is not active+clean 2024-04-17T02:22:25.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.31 is not active+clean 2024-04-17T02:22:25.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2024-04-17T02:22:25.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2f is not active+clean 2024-04-17T02:22:25.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2e is not active+clean 2024-04-17T02:22:25.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2024-04-17T02:22:25.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2c is not active+clean 2024-04-17T02:22:25.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2b is not active+clean 2024-04-17T02:22:25.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2a is not active+clean 2024-04-17T02:22:25.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2024-04-17T02:22:25.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.28 is not active+clean 2024-04-17T02:22:25.981 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.27 is not active+clean 2024-04-17T02:22:25.981 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.26 is not active+clean 2024-04-17T02:22:25.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2024-04-17T02:22:25.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.24 is not active+clean 2024-04-17T02:22:25.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2024-04-17T02:22:25.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.22 is not active+clean 2024-04-17T02:22:25.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.21 is not active+clean 2024-04-17T02:22:25.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.20 is not active+clean 2024-04-17T02:22:25.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2024-04-17T02:22:25.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2024-04-17T02:22:25.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:20.233009+0000', 'last_change': '2024-04-17T02:22:20.233009+0000', 'last_active': '2024-04-17T02:22:20.233009+0000', 'last_peered': '2024-04-17T02:22:20.233009+0000', 'last_clean': '2024-04-17T02:22:20.233009+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:20.233009+0000', 'last_undegraded': '2024-04-17T02:22:20.233009+0000', 'last_fullsized': '2024-04-17T02:22:20.233009+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2024-04-17T02:22:25.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2024-04-17T02:22:25.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:20.233009+0000', 'last_change': '2024-04-17T02:22:20.233009+0000', 'last_active': '2024-04-17T02:22:20.233009+0000', 'last_peered': '2024-04-17T02:22:20.233009+0000', 'last_clean': '2024-04-17T02:22:20.233009+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:20.233009+0000', 'last_undegraded': '2024-04-17T02:22:20.233009+0000', 'last_fullsized': '2024-04-17T02:22:20.233009+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2024-04-17T02:22:25.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2024-04-17T02:22:25.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:20.233009+0000', 'last_change': '2024-04-17T02:22:20.233009+0000', 'last_active': '2024-04-17T02:22:20.233009+0000', 'last_peered': '2024-04-17T02:22:20.233009+0000', 'last_clean': '2024-04-17T02:22:20.233009+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:20.233009+0000', 'last_undegraded': '2024-04-17T02:22:20.233009+0000', 'last_fullsized': '2024-04-17T02:22:20.233009+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2024-04-17T02:22:25.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2024-04-17T02:22:25.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:20.233009+0000', 'last_change': '2024-04-17T02:22:20.233009+0000', 'last_active': '2024-04-17T02:22:20.233009+0000', 'last_peered': '2024-04-17T02:22:20.233009+0000', 'last_clean': '2024-04-17T02:22:20.233009+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:20.233009+0000', 'last_undegraded': '2024-04-17T02:22:20.233009+0000', 'last_fullsized': '2024-04-17T02:22:20.233009+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2024-04-17T02:22:25.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:20.233009+0000', 'last_change': '2024-04-17T02:22:20.233009+0000', 'last_active': '2024-04-17T02:22:20.233009+0000', 'last_peered': '2024-04-17T02:22:20.233009+0000', 'last_clean': '2024-04-17T02:22:20.233009+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:20.233009+0000', 'last_undegraded': '2024-04-17T02:22:20.233009+0000', 'last_fullsized': '2024-04-17T02:22:20.233009+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2024-04-17T02:22:25.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2024-04-17T02:22:25.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:20.233009+0000', 'last_change': '2024-04-17T02:22:20.233009+0000', 'last_active': '2024-04-17T02:22:20.233009+0000', 'last_peered': '2024-04-17T02:22:20.233009+0000', 'last_clean': '2024-04-17T02:22:20.233009+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:20.233009+0000', 'last_undegraded': '2024-04-17T02:22:20.233009+0000', 'last_fullsized': '2024-04-17T02:22:20.233009+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2024-04-17T02:22:25.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2024-04-17T02:22:25.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:20.233009+0000', 'last_change': '2024-04-17T02:22:20.233009+0000', 'last_active': '2024-04-17T02:22:20.233009+0000', 'last_peered': '2024-04-17T02:22:20.233009+0000', 'last_clean': '2024-04-17T02:22:20.233009+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:20.233009+0000', 'last_undegraded': '2024-04-17T02:22:20.233009+0000', 'last_fullsized': '2024-04-17T02:22:20.233009+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2024-04-17T02:22:25.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2024-04-17T02:22:25.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:20.233009+0000', 'last_change': '2024-04-17T02:22:20.233009+0000', 'last_active': '2024-04-17T02:22:20.233009+0000', 'last_peered': '2024-04-17T02:22:20.233009+0000', 'last_clean': '2024-04-17T02:22:20.233009+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:20.233009+0000', 'last_undegraded': '2024-04-17T02:22:20.233009+0000', 'last_fullsized': '2024-04-17T02:22:20.233009+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2024-04-17T02:22:25.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2024-04-17T02:22:25.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:20.233009+0000', 'last_change': '2024-04-17T02:22:20.233009+0000', 'last_active': '2024-04-17T02:22:20.233009+0000', 'last_peered': '2024-04-17T02:22:20.233009+0000', 'last_clean': '2024-04-17T02:22:20.233009+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:20.233009+0000', 'last_undegraded': '2024-04-17T02:22:20.233009+0000', 'last_fullsized': '2024-04-17T02:22:20.233009+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2024-04-17T02:22:25.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2024-04-17T02:22:25.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:20.233009+0000', 'last_change': '2024-04-17T02:22:20.233009+0000', 'last_active': '2024-04-17T02:22:20.233009+0000', 'last_peered': '2024-04-17T02:22:20.233009+0000', 'last_clean': '2024-04-17T02:22:20.233009+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:20.233009+0000', 'last_undegraded': '2024-04-17T02:22:20.233009+0000', 'last_fullsized': '2024-04-17T02:22:20.233009+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2024-04-17T02:22:25.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2024-04-17T02:22:25.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:20.233009+0000', 'last_change': '2024-04-17T02:22:20.233009+0000', 'last_active': '2024-04-17T02:22:20.233009+0000', 'last_peered': '2024-04-17T02:22:20.233009+0000', 'last_clean': '2024-04-17T02:22:20.233009+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:20.233009+0000', 'last_undegraded': '2024-04-17T02:22:20.233009+0000', 'last_fullsized': '2024-04-17T02:22:20.233009+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2024-04-17T02:22:25.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2024-04-17T02:22:25.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:20.233009+0000', 'last_change': '2024-04-17T02:22:20.233009+0000', 'last_active': '2024-04-17T02:22:20.233009+0000', 'last_peered': '2024-04-17T02:22:20.233009+0000', 'last_clean': '2024-04-17T02:22:20.233009+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:20.233009+0000', 'last_undegraded': '2024-04-17T02:22:20.233009+0000', 'last_fullsized': '2024-04-17T02:22:20.233009+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2024-04-17T02:22:25.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2024-04-17T02:22:25.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:20.233009+0000', 'last_change': '2024-04-17T02:22:20.233009+0000', 'last_active': '2024-04-17T02:22:20.233009+0000', 'last_peered': '2024-04-17T02:22:20.233009+0000', 'last_clean': '2024-04-17T02:22:20.233009+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:20.233009+0000', 'last_undegraded': '2024-04-17T02:22:20.233009+0000', 'last_fullsized': '2024-04-17T02:22:20.233009+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2024-04-17T02:22:25.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2024-04-17T02:22:25.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:20.233009+0000', 'last_change': '2024-04-17T02:22:20.233009+0000', 'last_active': '2024-04-17T02:22:20.233009+0000', 'last_peered': '2024-04-17T02:22:20.233009+0000', 'last_clean': '2024-04-17T02:22:20.233009+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:20.233009+0000', 'last_undegraded': '2024-04-17T02:22:20.233009+0000', 'last_fullsized': '2024-04-17T02:22:20.233009+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2024-04-17T02:22:25.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2024-04-17T02:22:25.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:20.233009+0000', 'last_change': '2024-04-17T02:22:20.233009+0000', 'last_active': '2024-04-17T02:22:20.233009+0000', 'last_peered': '2024-04-17T02:22:20.233009+0000', 'last_clean': '2024-04-17T02:22:20.233009+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:20.233009+0000', 'last_undegraded': '2024-04-17T02:22:20.233009+0000', 'last_fullsized': '2024-04-17T02:22:20.233009+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2024-04-17T02:22:25.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2024-04-17T02:22:25.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:20.233009+0000', 'last_change': '2024-04-17T02:22:20.233009+0000', 'last_active': '2024-04-17T02:22:20.233009+0000', 'last_peered': '2024-04-17T02:22:20.233009+0000', 'last_clean': '2024-04-17T02:22:20.233009+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:20.233009+0000', 'last_undegraded': '2024-04-17T02:22:20.233009+0000', 'last_fullsized': '2024-04-17T02:22:20.233009+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2024-04-17T02:22:25.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2024-04-17T02:22:25.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:20.233009+0000', 'last_change': '2024-04-17T02:22:20.233009+0000', 'last_active': '2024-04-17T02:22:20.233009+0000', 'last_peered': '2024-04-17T02:22:20.233009+0000', 'last_clean': '2024-04-17T02:22:20.233009+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:20.233009+0000', 'last_undegraded': '2024-04-17T02:22:20.233009+0000', 'last_fullsized': '2024-04-17T02:22:20.233009+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2024-04-17T02:22:25.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2024-04-17T02:22:25.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:20.233009+0000', 'last_change': '2024-04-17T02:22:20.233009+0000', 'last_active': '2024-04-17T02:22:20.233009+0000', 'last_peered': '2024-04-17T02:22:20.233009+0000', 'last_clean': '2024-04-17T02:22:20.233009+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:20.233009+0000', 'last_undegraded': '2024-04-17T02:22:20.233009+0000', 'last_fullsized': '2024-04-17T02:22:20.233009+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2024-04-17T02:22:25.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2024-04-17T02:22:25.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:20.233009+0000', 'last_change': '2024-04-17T02:22:20.233009+0000', 'last_active': '2024-04-17T02:22:20.233009+0000', 'last_peered': '2024-04-17T02:22:20.233009+0000', 'last_clean': '2024-04-17T02:22:20.233009+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:20.233009+0000', 'last_undegraded': '2024-04-17T02:22:20.233009+0000', 'last_fullsized': '2024-04-17T02:22:20.233009+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:25.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2024-04-17T02:22:26.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:26.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2024-04-17T02:22:26.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:20.233009+0000', 'last_change': '2024-04-17T02:22:20.233009+0000', 'last_active': '2024-04-17T02:22:20.233009+0000', 'last_peered': '2024-04-17T02:22:20.233009+0000', 'last_clean': '2024-04-17T02:22:20.233009+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:20.233009+0000', 'last_undegraded': '2024-04-17T02:22:20.233009+0000', 'last_fullsized': '2024-04-17T02:22:20.233009+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:26.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2024-04-17T02:22:26.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:26.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2024-04-17T02:22:26.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:26.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2024-04-17T02:22:26.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:20.233009+0000', 'last_change': '2024-04-17T02:22:20.233009+0000', 'last_active': '2024-04-17T02:22:20.233009+0000', 'last_peered': '2024-04-17T02:22:20.233009+0000', 'last_clean': '2024-04-17T02:22:20.233009+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:20.233009+0000', 'last_undegraded': '2024-04-17T02:22:20.233009+0000', 'last_fullsized': '2024-04-17T02:22:20.233009+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:26.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2024-04-17T02:22:26.002 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:26.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2024-04-17T02:22:26.002 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:20.233009+0000', 'last_change': '2024-04-17T02:22:20.233009+0000', 'last_active': '2024-04-17T02:22:20.233009+0000', 'last_peered': '2024-04-17T02:22:20.233009+0000', 'last_clean': '2024-04-17T02:22:20.233009+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:20.233009+0000', 'last_undegraded': '2024-04-17T02:22:20.233009+0000', 'last_fullsized': '2024-04-17T02:22:20.233009+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:26.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2024-04-17T02:22:26.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:20.233009+0000', 'last_change': '2024-04-17T02:22:20.233009+0000', 'last_active': '2024-04-17T02:22:20.233009+0000', 'last_peered': '2024-04-17T02:22:20.233009+0000', 'last_clean': '2024-04-17T02:22:20.233009+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:20.233009+0000', 'last_undegraded': '2024-04-17T02:22:20.233009+0000', 'last_fullsized': '2024-04-17T02:22:20.233009+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:26.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2024-04-17T02:22:26.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:26.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2024-04-17T02:22:26.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:20.233009+0000', 'last_change': '2024-04-17T02:22:20.233009+0000', 'last_active': '2024-04-17T02:22:20.233009+0000', 'last_peered': '2024-04-17T02:22:20.233009+0000', 'last_clean': '2024-04-17T02:22:20.233009+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:20.233009+0000', 'last_undegraded': '2024-04-17T02:22:20.233009+0000', 'last_fullsized': '2024-04-17T02:22:20.233009+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:26.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2024-04-17T02:22:26.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:26.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2024-04-17T02:22:26.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:26.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2024-04-17T02:22:26.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:20.233009+0000', 'last_change': '2024-04-17T02:22:20.233009+0000', 'last_active': '2024-04-17T02:22:20.233009+0000', 'last_peered': '2024-04-17T02:22:20.233009+0000', 'last_clean': '2024-04-17T02:22:20.233009+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:20.233009+0000', 'last_undegraded': '2024-04-17T02:22:20.233009+0000', 'last_fullsized': '2024-04-17T02:22:20.233009+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:26.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2024-04-17T02:22:26.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:26.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2024-04-17T02:22:26.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:20.233009+0000', 'last_change': '2024-04-17T02:22:20.233009+0000', 'last_active': '2024-04-17T02:22:20.233009+0000', 'last_peered': '2024-04-17T02:22:20.233009+0000', 'last_clean': '2024-04-17T02:22:20.233009+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:20.233009+0000', 'last_undegraded': '2024-04-17T02:22:20.233009+0000', 'last_fullsized': '2024-04-17T02:22:20.233009+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:26.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2024-04-17T02:22:26.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:26.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2024-04-17T02:22:26.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:20.233009+0000', 'last_change': '2024-04-17T02:22:20.233009+0000', 'last_active': '2024-04-17T02:22:20.233009+0000', 'last_peered': '2024-04-17T02:22:20.233009+0000', 'last_clean': '2024-04-17T02:22:20.233009+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:20.233009+0000', 'last_undegraded': '2024-04-17T02:22:20.233009+0000', 'last_fullsized': '2024-04-17T02:22:20.233009+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:26.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2024-04-17T02:22:26.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:26.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2024-04-17T02:22:26.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:20.233009+0000', 'last_change': '2024-04-17T02:22:20.233009+0000', 'last_active': '2024-04-17T02:22:20.233009+0000', 'last_peered': '2024-04-17T02:22:20.233009+0000', 'last_clean': '2024-04-17T02:22:20.233009+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:20.233009+0000', 'last_undegraded': '2024-04-17T02:22:20.233009+0000', 'last_fullsized': '2024-04-17T02:22:20.233009+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:26.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2024-04-17T02:22:26.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:26.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2024-04-17T02:22:26.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:20.233009+0000', 'last_change': '2024-04-17T02:22:20.233009+0000', 'last_active': '2024-04-17T02:22:20.233009+0000', 'last_peered': '2024-04-17T02:22:20.233009+0000', 'last_clean': '2024-04-17T02:22:20.233009+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:20.233009+0000', 'last_undegraded': '2024-04-17T02:22:20.233009+0000', 'last_fullsized': '2024-04-17T02:22:20.233009+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:26.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2024-04-17T02:22:26.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:26.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2024-04-17T02:22:26.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:20.233009+0000', 'last_change': '2024-04-17T02:22:20.233009+0000', 'last_active': '2024-04-17T02:22:20.233009+0000', 'last_peered': '2024-04-17T02:22:20.233009+0000', 'last_clean': '2024-04-17T02:22:20.233009+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:20.233009+0000', 'last_undegraded': '2024-04-17T02:22:20.233009+0000', 'last_fullsized': '2024-04-17T02:22:20.233009+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:26.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2024-04-17T02:22:26.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:26.010 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2024-04-17T02:22:26.010 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:20.233009+0000', 'last_change': '2024-04-17T02:22:20.233009+0000', 'last_active': '2024-04-17T02:22:20.233009+0000', 'last_peered': '2024-04-17T02:22:20.233009+0000', 'last_clean': '2024-04-17T02:22:20.233009+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:20.233009+0000', 'last_undegraded': '2024-04-17T02:22:20.233009+0000', 'last_fullsized': '2024-04-17T02:22:20.233009+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:26.010 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2024-04-17T02:22:26.010 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:21.235005+0000', 'last_change': '2024-04-17T02:22:21.235005+0000', 'last_active': '2024-04-17T02:22:21.235005+0000', 'last_peered': '2024-04-17T02:22:21.235005+0000', 'last_clean': '2024-04-17T02:22:21.235005+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:21.235005+0000', 'last_undegraded': '2024-04-17T02:22:21.235005+0000', 'last_fullsized': '2024-04-17T02:22:21.235005+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:21.235005+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:26.011 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2024-04-17T02:22:26.011 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-17T02:22:20.233009+0000', 'last_change': '2024-04-17T02:22:20.233009+0000', 'last_active': '2024-04-17T02:22:20.233009+0000', 'last_peered': '2024-04-17T02:22:20.233009+0000', 'last_clean': '2024-04-17T02:22:20.233009+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-17T02:22:20.233009+0000', 'last_undegraded': '2024-04-17T02:22:20.233009+0000', 'last_fullsized': '2024-04-17T02:22:20.233009+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'last_clean_scrub_stamp': '2024-04-17T02:22:20.233009+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-17T02:22:26.012 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-17T02:22:26.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.114+0000 7ff91189d640 1 Processor -- start 2024-04-17T02:22:26.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.114+0000 7ff91189d640 1 -- start start 2024-04-17T02:22:26.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.115+0000 7ff91189d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff90c0733d0 0x7ff90c0a5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:26.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.115+0000 7ff91189d640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7ff90c0a60e0 0x7ff90c14d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:26.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.115+0000 7ff91189d640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff90c0a8f30 con 0x7ff90c143a20 2024-04-17T02:22:26.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.115+0000 7ff91189d640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7ff90c0a7360 con 0x7ff90c0733d0 2024-04-17T02:22:26.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.115+0000 7ff91189d640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7ff90c0a7620 con 0x7ff90c0a60e0 2024-04-17T02:22:26.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.115+0000 7ff90affd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ff90c143a20 0x7ff90c0a8260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39886/0 (socket says 172.21.15.17:39886) 2024-04-17T02:22:26.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.115+0000 7ff90affd640 1 -- 172.21.15.17:0/193611948 learned_addr learned my addr 172.21.15.17:0/193611948 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:22:26.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.115+0000 7ff90b7fe640 1 --2- 172.21.15.17:0/193611948 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7ff90c0a60e0 0x7ff90c14d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:26.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.115+0000 7ff90a7fc640 1 --2- 172.21.15.17:0/193611948 >> v2:172.21.15.122:3300/0 conn(0x7ff90c0733d0 0x7ff90c0a5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:26.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.115+0000 7ff909ffb640 1 -- 172.21.15.17:0/193611948 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3806032852 0 0) 0x7ff90c0a8f30 con 0x7ff90c143a20 2024-04-17T02:22:26.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.115+0000 7ff909ffb640 1 -- 172.21.15.17:0/193611948 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8f8003520 con 0x7ff90c143a20 2024-04-17T02:22:26.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.115+0000 7ff90b7fe640 1 -- 172.21.15.17:0/193611948 >> v2:172.21.15.122:3300/0 conn(0x7ff90c0733d0 msgr2=0x7ff90c0a5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:26.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.115+0000 7ff90b7fe640 1 --2- 172.21.15.17:0/193611948 >> v2:172.21.15.122:3300/0 conn(0x7ff90c0733d0 0x7ff90c0a5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:26.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.115+0000 7ff90b7fe640 1 -- 172.21.15.17:0/193611948 >> v1:172.21.15.17:6789/0 conn(0x7ff90c143a20 legacy=0x7ff90c0a8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:26.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.115+0000 7ff90b7fe640 1 -- 172.21.15.17:0/193611948 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff90c0a7080 con 0x7ff90c0a60e0 2024-04-17T02:22:26.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.116+0000 7ff90b7fe640 1 --2- 172.21.15.17:0/193611948 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7ff90c0a60e0 0x7ff90c14d7f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc0097a0 tx=0x7ff8fc02b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1004a92a03e9b639 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:26.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.116+0000 7ff909ffb640 1 -- 172.21.15.17:0/193611948 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc038070 con 0x7ff90c0a60e0 2024-04-17T02:22:26.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.116+0000 7ff909ffb640 1 -- 172.21.15.17:0/193611948 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8fc031700 con 0x7ff90c0a60e0 2024-04-17T02:22:26.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.116+0000 7ff909ffb640 1 -- 172.21.15.17:0/193611948 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc031ad0 con 0x7ff90c0a60e0 2024-04-17T02:22:26.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.117+0000 7ff91189d640 1 -- 172.21.15.17:0/193611948 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7ff90c0a60e0 msgr2=0x7ff90c14d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:26.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.117+0000 7ff91189d640 1 --2- 172.21.15.17:0/193611948 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7ff90c0a60e0 0x7ff90c14d7f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc0097a0 tx=0x7ff8fc02b7a0 comp rx=0 tx=0).stop 2024-04-17T02:22:26.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.117+0000 7ff91189d640 1 -- 172.21.15.17:0/193611948 shutdown_connections 2024-04-17T02:22:26.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.117+0000 7ff91189d640 1 --2- 172.21.15.17:0/193611948 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7ff90c0a60e0 0x7ff90c14d7f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:26.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.117+0000 7ff91189d640 1 --2- 172.21.15.17:0/193611948 >> v2:172.21.15.122:3300/0 conn(0x7ff90c0733d0 0x7ff90c0a5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:26.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.117+0000 7ff91189d640 1 -- 172.21.15.17:0/193611948 >> 172.21.15.17:0/193611948 conn(0x7ff90c0746a0 msgr2=0x7ff90c0a7ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:26.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.117+0000 7ff91189d640 1 -- 172.21.15.17:0/193611948 shutdown_connections 2024-04-17T02:22:26.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.117+0000 7ff91189d640 1 -- 172.21.15.17:0/193611948 wait complete. 2024-04-17T02:22:26.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.118+0000 7ff91189d640 1 Processor -- start 2024-04-17T02:22:26.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.118+0000 7ff91189d640 1 -- start start 2024-04-17T02:22:26.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.119+0000 7ff91189d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff90c0733d0 0x7ff90c1cf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:26.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.119+0000 7ff91189d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff90c0a60e0 0x7ff90c137b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:26.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.119+0000 7ff91189d640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7ff90c143a20 0x7ff90c1cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:26.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.119+0000 7ff91189d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff90c072c70 con 0x7ff90c0733d0 2024-04-17T02:22:26.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.119+0000 7ff91189d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff90c072af0 con 0x7ff90c0a60e0 2024-04-17T02:22:26.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.119+0000 7ff91189d640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7ff90c0aaf00 con 0x7ff90c143a20 2024-04-17T02:22:26.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.119+0000 7ff90affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff90c0733d0 0x7ff90c1cf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:26.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.119+0000 7ff90b7fe640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7ff90c143a20 0x7ff90c1cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:26.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.119+0000 7ff90affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff90c0733d0 0x7ff90c1cf2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44608/0 (socket says 172.21.15.17:44608) 2024-04-17T02:22:26.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.119+0000 7ff90affd640 1 -- 172.21.15.17:0/1130604690 learned_addr learned my addr 172.21.15.17:0/1130604690 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:26.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.119+0000 7ff90a7fc640 1 --2- 172.21.15.17:0/1130604690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff90c0a60e0 0x7ff90c137b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:26.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.119+0000 7ff90affd640 1 -- 172.21.15.17:0/1130604690 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7ff90c143a20 msgr2=0x7ff90c1cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:26.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.119+0000 7ff90affd640 1 --2- 172.21.15.17:0/1130604690 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7ff90c143a20 0x7ff90c1cd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:26.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.119+0000 7ff90affd640 1 -- 172.21.15.17:0/1130604690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff90c0a60e0 msgr2=0x7ff90c137b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:26.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.119+0000 7ff90affd640 1 --2- 172.21.15.17:0/1130604690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff90c0a60e0 0x7ff90c137b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:26.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.119+0000 7ff90affd640 1 -- 172.21.15.17:0/1130604690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff90c1d8b70 con 0x7ff90c0733d0 2024-04-17T02:22:26.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.119+0000 7ff90affd640 1 --2- 172.21.15.17:0/1130604690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff90c0733d0 0x7ff90c1cf2c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff90400caa0 tx=0x7ff90400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:26.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.119+0000 7ff903fff640 1 -- 172.21.15.17:0/1130604690 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff904017070 con 0x7ff90c0733d0 2024-04-17T02:22:26.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.119+0000 7ff903fff640 1 -- 172.21.15.17:0/1130604690 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff90400ac00 con 0x7ff90c0733d0 2024-04-17T02:22:26.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.119+0000 7ff91189d640 1 -- 172.21.15.17:0/1130604690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff90c13eda0 con 0x7ff90c0733d0 2024-04-17T02:22:26.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.119+0000 7ff903fff640 1 -- 172.21.15.17:0/1130604690 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff904012400 con 0x7ff90c0733d0 2024-04-17T02:22:26.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.119+0000 7ff91189d640 1 -- 172.21.15.17:0/1130604690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff90c13c590 con 0x7ff90c0733d0 2024-04-17T02:22:26.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.120+0000 7ff91189d640 1 -- 172.21.15.17:0/1130604690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff90c0a56b0 con 0x7ff90c0733d0 2024-04-17T02:22:26.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.121+0000 7ff903fff640 1 -- 172.21.15.17:0/1130604690 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7ff90401a070 con 0x7ff90c0733d0 2024-04-17T02:22:26.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.121+0000 7ff903fff640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:26.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.122+0000 7ff903fff640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:26.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.122+0000 7ff903fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:26.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.122+0000 7ff903fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:26.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.122+0000 7ff903fff640 1 --2- 172.21.15.17:0/1130604690 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7ff8ec09f400 0x7ff8ec0a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:26.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.122+0000 7ff90a7fc640 1 --2- 172.21.15.17:0/1130604690 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7ff8ec09f400 0x7ff8ec0a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:26.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.122+0000 7ff903fff640 1 -- 172.21.15.17:0/1130604690 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7ff9040c92d0 con 0x7ff90c0733d0 2024-04-17T02:22:26.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.122+0000 7ff90a7fc640 1 --2- 172.21.15.17:0/1130604690 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7ff8ec09f400 0x7ff8ec0a18c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff90c1351c0 tx=0x7ff8f4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:26.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.126+0000 7ff903fff640 1 -- 172.21.15.17:0/1130604690 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ff90404de10 con 0x7ff90c0733d0 2024-04-17T02:22:26.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.376+0000 7ff91189d640 1 -- 172.21.15.17:0/1130604690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7ff90c13f030 con 0x7ff90c0733d0 2024-04-17T02:22:26.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.377+0000 7ff903fff640 1 -- 172.21.15.17:0/1130604690 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1022 (secure 0 0 0) 0x7ff90c13f030 con 0x7ff90c0733d0 2024-04-17T02:22:26.378 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:22:26.378 INFO:teuthology.orchestra.run.smithi017.stdout:{"fsid":"7cbfae20-b10d-41da-92b7-cbd5c1632e23","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":26,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":20,"num_osds":4,"num_up_osds":4,"osd_up_since":1713320529,"num_in_osds":4,"osd_in_since":1713320521,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":96},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":115638272,"bytes_avail":386431418368,"bytes_total":386547056640,"unknown_pgs_ratio":0.91428571939468384},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4254}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":2,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-04-17T02:22:00.247577+0000","services":{}},"progress_events":{}} 2024-04-17T02:22:26.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.378+0000 7ff91189d640 10 mgrc shutdown 2024-04-17T02:22:26.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.378+0000 7ff91189d640 1 -- 172.21.15.17:0/1130604690 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7ff8ec09f400 msgr2=0x7ff8ec0a18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:26.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.378+0000 7ff91189d640 1 --2- 172.21.15.17:0/1130604690 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7ff8ec09f400 0x7ff8ec0a18c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff90c1351c0 tx=0x7ff8f4008040 comp rx=0 tx=0).stop 2024-04-17T02:22:26.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.379+0000 7ff91189d640 1 -- 172.21.15.17:0/1130604690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff90c0733d0 msgr2=0x7ff90c1cf2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:26.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.379+0000 7ff91189d640 1 --2- 172.21.15.17:0/1130604690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff90c0733d0 0x7ff90c1cf2c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff90400caa0 tx=0x7ff90400cf60 comp rx=0 tx=0).stop 2024-04-17T02:22:26.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.379+0000 7ff91189d640 1 -- 172.21.15.17:0/1130604690 shutdown_connections 2024-04-17T02:22:26.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.379+0000 7ff91189d640 1 --2- 172.21.15.17:0/1130604690 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7ff8ec09f400 0x7ff8ec0a18c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:26.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.379+0000 7ff91189d640 1 --2- 172.21.15.17:0/1130604690 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7ff90c143a20 0x7ff90c1cd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:26.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.379+0000 7ff91189d640 1 --2- 172.21.15.17:0/1130604690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff90c0a60e0 0x7ff90c137b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:26.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.379+0000 7ff91189d640 1 --2- 172.21.15.17:0/1130604690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff90c0733d0 0x7ff90c1cf2c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:26.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.379+0000 7ff91189d640 1 -- 172.21.15.17:0/1130604690 >> 172.21.15.17:0/1130604690 conn(0x7ff90c0746a0 msgr2=0x7ff90c0a81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:26.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.379+0000 7ff91189d640 1 -- 172.21.15.17:0/1130604690 shutdown_connections 2024-04-17T02:22:26.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.379+0000 7ff91189d640 1 -- 172.21.15.17:0/1130604690 wait complete. 2024-04-17T02:22:26.391 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-17T02:22:26.391 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T02:22:26.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.494+0000 7fdfdd274640 1 Processor -- start 2024-04-17T02:22:26.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.494+0000 7fdfdd274640 1 -- start start 2024-04-17T02:22:26.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.495+0000 7fdfdd274640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fdfd813ba20 0x7fdfd80a6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:26.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.495+0000 7fdfdd274640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fdfd80a73f0 0x7fdfd814f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:26.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.495+0000 7fdfdd274640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfd80a6130 con 0x7fdfd80a8010 2024-04-17T02:22:26.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.495+0000 7fdfdd274640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fdfd80a83f0 con 0x7fdfd80a73f0 2024-04-17T02:22:26.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.495+0000 7fdfdd274640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fdfd80a7910 con 0x7fdfd813ba20 2024-04-17T02:22:26.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.495+0000 7fdfd77fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fdfd80a73f0 0x7fdfd814f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:26.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.495+0000 7fdfd6ffd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fdfd80a8010 0x7fdfd8148f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39892/0 (socket says 172.21.15.17:39892) 2024-04-17T02:22:26.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.495+0000 7fdfd6ffd640 1 -- 172.21.15.17:0/1644857221 learned_addr learned my addr 172.21.15.17:0/1644857221 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:22:26.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.495+0000 7fdfd67fc640 1 --2- 172.21.15.17:0/1644857221 >> v2:172.21.15.122:3300/0 conn(0x7fdfd813ba20 0x7fdfd80a6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:26.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.495+0000 7fdfd77fe640 1 -- 172.21.15.17:0/1644857221 >> v2:172.21.15.122:3300/0 conn(0x7fdfd813ba20 msgr2=0x7fdfd80a6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:26.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.495+0000 7fdfd77fe640 1 --2- 172.21.15.17:0/1644857221 >> v2:172.21.15.122:3300/0 conn(0x7fdfd813ba20 0x7fdfd80a6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:26.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.495+0000 7fdfd77fe640 1 -- 172.21.15.17:0/1644857221 >> v1:172.21.15.17:6789/0 conn(0x7fdfd80a8010 legacy=0x7fdfd8148f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:26.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.495+0000 7fdfd5ffb640 1 -- 172.21.15.17:0/1644857221 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1638617581 0 0) 0x7fdfd80a6130 con 0x7fdfd80a8010 2024-04-17T02:22:26.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.495+0000 7fdfd77fe640 1 -- 172.21.15.17:0/1644857221 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfd80a58c0 con 0x7fdfd80a73f0 2024-04-17T02:22:26.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.496+0000 7fdfd77fe640 1 --2- 172.21.15.17:0/1644857221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfd80a73f0 0x7fdfd814f9b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8072330 tx=0x7fdfd002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d417366e2f936fd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:26.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.496+0000 7fdfd5ffb640 1 -- 172.21.15.17:0/1644857221 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd0039070 con 0x7fdfd80a73f0 2024-04-17T02:22:26.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.496+0000 7fdfd5ffb640 1 -- 172.21.15.17:0/1644857221 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfd002cc80 con 0x7fdfd80a73f0 2024-04-17T02:22:26.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.496+0000 7fdfd5ffb640 1 -- 172.21.15.17:0/1644857221 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd0034660 con 0x7fdfd80a73f0 2024-04-17T02:22:26.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.497+0000 7fdfdd274640 1 -- 172.21.15.17:0/1644857221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfd80a73f0 msgr2=0x7fdfd814f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:26.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.497+0000 7fdfdd274640 1 --2- 172.21.15.17:0/1644857221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfd80a73f0 0x7fdfd814f9b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8072330 tx=0x7fdfd002bed0 comp rx=0 tx=0).stop 2024-04-17T02:22:26.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.497+0000 7fdfdd274640 1 -- 172.21.15.17:0/1644857221 shutdown_connections 2024-04-17T02:22:26.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.497+0000 7fdfdd274640 1 --2- 172.21.15.17:0/1644857221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfd80a73f0 0x7fdfd814f9b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:26.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.497+0000 7fdfdd274640 1 --2- 172.21.15.17:0/1644857221 >> v2:172.21.15.122:3300/0 conn(0x7fdfd813ba20 0x7fdfd80a6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:26.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.497+0000 7fdfdd274640 1 -- 172.21.15.17:0/1644857221 >> 172.21.15.17:0/1644857221 conn(0x7fdfd80741a0 msgr2=0x7fdfd80745b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:26.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.497+0000 7fdfdd274640 1 -- 172.21.15.17:0/1644857221 shutdown_connections 2024-04-17T02:22:26.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.497+0000 7fdfdd274640 1 -- 172.21.15.17:0/1644857221 wait complete. 2024-04-17T02:22:26.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.498+0000 7fdfdd274640 1 Processor -- start 2024-04-17T02:22:26.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.498+0000 7fdfdd274640 1 -- start start 2024-04-17T02:22:26.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.498+0000 7fdfdd274640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfd80a73f0 0x7fdfd80b9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:26.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.498+0000 7fdfdd274640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fdfd80a8010 0x7fdfd81de190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:26.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.498+0000 7fdfdd274640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdfd813ba20 0x7fdfd80a4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:26.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.498+0000 7fdfdd274640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd80a5ae0 con 0x7fdfd80a73f0 2024-04-17T02:22:26.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.498+0000 7fdfdd274640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd80723a0 con 0x7fdfd813ba20 2024-04-17T02:22:26.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.498+0000 7fdfdd274640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fdfd80a5c60 con 0x7fdfd80a8010 2024-04-17T02:22:26.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.499+0000 7fdfd6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfd80a73f0 0x7fdfd80b9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:26.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.499+0000 7fdfd6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfd80a73f0 0x7fdfd80b9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44630/0 (socket says 172.21.15.17:44630) 2024-04-17T02:22:26.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.499+0000 7fdfd6ffd640 1 -- 172.21.15.17:0/1370275122 learned_addr learned my addr 172.21.15.17:0/1370275122 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:26.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.499+0000 7fdfd67fc640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fdfd80a8010 0x7fdfd81de190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:26.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.499+0000 7fdfd77fe640 1 --2- 172.21.15.17:0/1370275122 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdfd813ba20 0x7fdfd80a4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:26.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.499+0000 7fdfd6ffd640 1 -- 172.21.15.17:0/1370275122 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fdfd80a8010 msgr2=0x7fdfd81de190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:26.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.499+0000 7fdfd6ffd640 1 --2- 172.21.15.17:0/1370275122 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fdfd80a8010 0x7fdfd81de190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:26.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.499+0000 7fdfd6ffd640 1 -- 172.21.15.17:0/1370275122 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdfd813ba20 msgr2=0x7fdfd80a4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:26.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.499+0000 7fdfd6ffd640 1 --2- 172.21.15.17:0/1370275122 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdfd813ba20 0x7fdfd80a4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:26.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.499+0000 7fdfd6ffd640 1 -- 172.21.15.17:0/1370275122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfd806f600 con 0x7fdfd80a73f0 2024-04-17T02:22:26.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.499+0000 7fdfd77fe640 1 --2- 172.21.15.17:0/1370275122 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdfd813ba20 0x7fdfd80a4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T02:22:26.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.499+0000 7fdfd6ffd640 1 --2- 172.21.15.17:0/1370275122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfd80a73f0 0x7fdfd80b9090 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdfc800c500 tx=0x7fdfc800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:26.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.499+0000 7fdfbf7fe640 1 -- 172.21.15.17:0/1370275122 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc8018070 con 0x7fdfd80a73f0 2024-04-17T02:22:26.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.499+0000 7fdfbf7fe640 1 -- 172.21.15.17:0/1370275122 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfc8007580 con 0x7fdfd80a73f0 2024-04-17T02:22:26.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.499+0000 7fdfdd274640 1 -- 172.21.15.17:0/1370275122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfd81daaa0 con 0x7fdfd80a73f0 2024-04-17T02:22:26.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.499+0000 7fdfbf7fe640 1 -- 172.21.15.17:0/1370275122 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc8004a20 con 0x7fdfd80a73f0 2024-04-17T02:22:26.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.499+0000 7fdfdd274640 1 -- 172.21.15.17:0/1370275122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfd80b95d0 con 0x7fdfd80a73f0 2024-04-17T02:22:26.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.500+0000 7fdfdd274640 1 -- 172.21.15.17:0/1370275122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfd80687f0 con 0x7fdfd80a73f0 2024-04-17T02:22:26.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.501+0000 7fdfbf7fe640 1 -- 172.21.15.17:0/1370275122 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7fdfc801b070 con 0x7fdfd80a73f0 2024-04-17T02:22:26.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.501+0000 7fdfbf7fe640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:26.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.502+0000 7fdfbf7fe640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:26.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.502+0000 7fdfbf7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:26.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.502+0000 7fdfbf7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:26.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.502+0000 7fdfbf7fe640 1 --2- 172.21.15.17:0/1370275122 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fdfc409f480 0x7fdfc40a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:26.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.502+0000 7fdfd67fc640 1 --2- 172.21.15.17:0/1370275122 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fdfc409f480 0x7fdfc40a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:26.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.502+0000 7fdfbf7fe640 1 -- 172.21.15.17:0/1370275122 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7fdfc80c8690 con 0x7fdfd80a73f0 2024-04-17T02:22:26.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.502+0000 7fdfd67fc640 1 --2- 172.21.15.17:0/1370275122 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fdfc409f480 0x7fdfc40a1940 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdfd806f890 tx=0x7fdfcc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:26.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.506+0000 7fdfbf7fe640 1 -- 172.21.15.17:0/1370275122 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fdfc80976f0 con 0x7fdfd80a73f0 2024-04-17T02:22:26.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.686+0000 7fdfdd274640 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2024-04-17T02:22:26.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.686+0000 7fdfdd274640 1 -- 172.21.15.17:0/1370275122 --> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdfd80a8ce0 con 0x7fdfc409f480 2024-04-17T02:22:26.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.693+0000 7fdfbf7fe640 1 -- 172.21.15.17:0/1370275122 <== mgr.4103 v2:172.21.15.17:6808/563692809 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+268678 (secure 0 0 0) 0x7fdfd80a8ce0 con 0x7fdfc409f480 2024-04-17T02:22:26.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.693+0000 7fdfbf7fe640 20 mgrc handle_command_reply tid 0 r 0 2024-04-17T02:22:26.697 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:22:26.699 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-04-17T02:22:26.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.696+0000 7fdfdd274640 10 mgrc shutdown 2024-04-17T02:22:26.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.696+0000 7fdfdd274640 1 -- 172.21.15.17:0/1370275122 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fdfc409f480 msgr2=0x7fdfc40a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:26.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.696+0000 7fdfdd274640 1 --2- 172.21.15.17:0/1370275122 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fdfc409f480 0x7fdfc40a1940 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdfd806f890 tx=0x7fdfcc008040 comp rx=0 tx=0).stop 2024-04-17T02:22:26.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.696+0000 7fdfdd274640 1 -- 172.21.15.17:0/1370275122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfd80a73f0 msgr2=0x7fdfd80b9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:26.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.696+0000 7fdfdd274640 1 --2- 172.21.15.17:0/1370275122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfd80a73f0 0x7fdfd80b9090 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdfc800c500 tx=0x7fdfc800c9c0 comp rx=0 tx=0).stop 2024-04-17T02:22:26.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.696+0000 7fdfdd274640 1 -- 172.21.15.17:0/1370275122 shutdown_connections 2024-04-17T02:22:26.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.696+0000 7fdfdd274640 1 --2- 172.21.15.17:0/1370275122 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fdfc409f480 0x7fdfc40a1940 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:26.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.696+0000 7fdfdd274640 1 --2- 172.21.15.17:0/1370275122 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdfd813ba20 0x7fdfd80a4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:26.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.696+0000 7fdfdd274640 1 --2- 172.21.15.17:0/1370275122 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fdfd80a8010 0x7fdfd81de190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:26.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.696+0000 7fdfdd274640 1 --2- 172.21.15.17:0/1370275122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfd80a73f0 0x7fdfd80b9090 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:26.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.696+0000 7fdfdd274640 1 -- 172.21.15.17:0/1370275122 >> 172.21.15.17:0/1370275122 conn(0x7fdfd80741a0 msgr2=0x7fdfd806cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:26.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.696+0000 7fdfdd274640 1 -- 172.21.15.17:0/1370275122 shutdown_connections 2024-04-17T02:22:26.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:26.696+0000 7fdfdd274640 1 -- 172.21.15.17:0/1370275122 wait complete. 2024-04-17T02:22:26.708 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-04-17T02:22:26.505070+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":124,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":113176,"kb_used_data":912,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377374184,"statfs":{"total":386547056640,"available":386431164416,"internally_reserved":0,"allocated":933888,"data_stored":1439892,"data_compressed":65024,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":6377,"internal_metadata":114878231},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000826"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247513+0000","last_change":"2024-04-17T02:22:22.259104+0000","last_active":"2024-04-17T02:22:23.247513+0000","last_peered":"2024-04-17T02:22:23.247513+0000","last_clean":"2024-04-17T02:22:23.247513+0000","last_became_active":"2024-04-17T02:22:22.258830+0000","last_became_peered":"2024-04-17T02:22:22.258830+0000","last_unstale":"2024-04-17T02:22:23.247513+0000","last_undegraded":"2024-04-17T02:22:23.247513+0000","last_fullsized":"2024-04-17T02:22:23.247513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:42:09.532783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245851+0000","last_change":"2024-04-17T02:22:22.274708+0000","last_active":"2024-04-17T02:22:23.245851+0000","last_peered":"2024-04-17T02:22:23.245851+0000","last_clean":"2024-04-17T02:22:23.245851+0000","last_became_active":"2024-04-17T02:22:22.274397+0000","last_became_peered":"2024-04-17T02:22:22.274397+0000","last_unstale":"2024-04-17T02:22:23.245851+0000","last_undegraded":"2024-04-17T02:22:23.245851+0000","last_fullsized":"2024-04-17T02:22:23.245851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:04:31.488847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245739+0000","last_change":"2024-04-17T02:22:22.257081+0000","last_active":"2024-04-17T02:22:23.245739+0000","last_peered":"2024-04-17T02:22:23.245739+0000","last_clean":"2024-04-17T02:22:23.245739+0000","last_became_active":"2024-04-17T02:22:22.256695+0000","last_became_peered":"2024-04-17T02:22:22.256695+0000","last_unstale":"2024-04-17T02:22:23.245739+0000","last_undegraded":"2024-04-17T02:22:23.245739+0000","last_fullsized":"2024-04-17T02:22:23.245739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:52:02.173760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962692+0000","last_change":"2024-04-17T02:22:22.272106+0000","last_active":"2024-04-17T02:22:23.962692+0000","last_peered":"2024-04-17T02:22:23.962692+0000","last_clean":"2024-04-17T02:22:23.962692+0000","last_became_active":"2024-04-17T02:22:22.271074+0000","last_became_peered":"2024-04-17T02:22:22.271074+0000","last_unstale":"2024-04-17T02:22:23.962692+0000","last_undegraded":"2024-04-17T02:22:23.962692+0000","last_fullsized":"2024-04-17T02:22:23.962692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:45:41.860323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248355+0000","last_change":"2024-04-17T02:22:22.258839+0000","last_active":"2024-04-17T02:22:23.248355+0000","last_peered":"2024-04-17T02:22:23.248355+0000","last_clean":"2024-04-17T02:22:23.248355+0000","last_became_active":"2024-04-17T02:22:22.257715+0000","last_became_peered":"2024-04-17T02:22:22.257715+0000","last_unstale":"2024-04-17T02:22:23.248355+0000","last_undegraded":"2024-04-17T02:22:23.248355+0000","last_fullsized":"2024-04-17T02:22:23.248355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:26:13.695328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247496+0000","last_change":"2024-04-17T02:22:22.259395+0000","last_active":"2024-04-17T02:22:23.247496+0000","last_peered":"2024-04-17T02:22:23.247496+0000","last_clean":"2024-04-17T02:22:23.247496+0000","last_became_active":"2024-04-17T02:22:22.258508+0000","last_became_peered":"2024-04-17T02:22:22.258508+0000","last_unstale":"2024-04-17T02:22:23.247496+0000","last_undegraded":"2024-04-17T02:22:23.247496+0000","last_fullsized":"2024-04-17T02:22:23.247496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:34:29.435312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248096+0000","last_change":"2024-04-17T02:22:22.261760+0000","last_active":"2024-04-17T02:22:23.248096+0000","last_peered":"2024-04-17T02:22:23.248096+0000","last_clean":"2024-04-17T02:22:23.248096+0000","last_became_active":"2024-04-17T02:22:22.261501+0000","last_became_peered":"2024-04-17T02:22:22.261501+0000","last_unstale":"2024-04-17T02:22:23.248096+0000","last_undegraded":"2024-04-17T02:22:23.248096+0000","last_fullsized":"2024-04-17T02:22:23.248096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:07:20.363260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.244553+0000","last_change":"2024-04-17T02:22:22.257716+0000","last_active":"2024-04-17T02:22:23.244553+0000","last_peered":"2024-04-17T02:22:23.244553+0000","last_clean":"2024-04-17T02:22:23.244553+0000","last_became_active":"2024-04-17T02:22:22.257354+0000","last_became_peered":"2024-04-17T02:22:22.257354+0000","last_unstale":"2024-04-17T02:22:23.244553+0000","last_undegraded":"2024-04-17T02:22:23.244553+0000","last_fullsized":"2024-04-17T02:22:23.244553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:45:35.746928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247533+0000","last_change":"2024-04-17T02:22:22.261339+0000","last_active":"2024-04-17T02:22:23.247533+0000","last_peered":"2024-04-17T02:22:23.247533+0000","last_clean":"2024-04-17T02:22:23.247533+0000","last_became_active":"2024-04-17T02:22:22.258124+0000","last_became_peered":"2024-04-17T02:22:22.258124+0000","last_unstale":"2024-04-17T02:22:23.247533+0000","last_undegraded":"2024-04-17T02:22:23.247533+0000","last_fullsized":"2024-04-17T02:22:23.247533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:31:34.863748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962968+0000","last_change":"2024-04-17T02:22:22.276919+0000","last_active":"2024-04-17T02:22:23.962968+0000","last_peered":"2024-04-17T02:22:23.962968+0000","last_clean":"2024-04-17T02:22:23.962968+0000","last_became_active":"2024-04-17T02:22:22.273911+0000","last_became_peered":"2024-04-17T02:22:22.273911+0000","last_unstale":"2024-04-17T02:22:23.962968+0000","last_undegraded":"2024-04-17T02:22:23.962968+0000","last_fullsized":"2024-04-17T02:22:23.962968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:33:01.850142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962960+0000","last_change":"2024-04-17T02:22:22.269997+0000","last_active":"2024-04-17T02:22:23.962960+0000","last_peered":"2024-04-17T02:22:23.962960+0000","last_clean":"2024-04-17T02:22:23.962960+0000","last_became_active":"2024-04-17T02:22:22.269071+0000","last_became_peered":"2024-04-17T02:22:22.269071+0000","last_unstale":"2024-04-17T02:22:23.962960+0000","last_undegraded":"2024-04-17T02:22:23.962960+0000","last_fullsized":"2024-04-17T02:22:23.962960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:28:17.292009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246781+0000","last_change":"2024-04-17T02:22:22.255449+0000","last_active":"2024-04-17T02:22:23.246781+0000","last_peered":"2024-04-17T02:22:23.246781+0000","last_clean":"2024-04-17T02:22:23.246781+0000","last_became_active":"2024-04-17T02:22:22.254619+0000","last_became_peered":"2024-04-17T02:22:22.254619+0000","last_unstale":"2024-04-17T02:22:23.246781+0000","last_undegraded":"2024-04-17T02:22:23.246781+0000","last_fullsized":"2024-04-17T02:22:23.246781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:29:09.389819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246450+0000","last_change":"2024-04-17T02:22:22.257767+0000","last_active":"2024-04-17T02:22:23.246450+0000","last_peered":"2024-04-17T02:22:23.246450+0000","last_clean":"2024-04-17T02:22:23.246450+0000","last_became_active":"2024-04-17T02:22:22.257506+0000","last_became_peered":"2024-04-17T02:22:22.257506+0000","last_unstale":"2024-04-17T02:22:23.246450+0000","last_undegraded":"2024-04-17T02:22:23.246450+0000","last_fullsized":"2024-04-17T02:22:23.246450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:36:11.795618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245156+0000","last_change":"2024-04-17T02:22:22.254083+0000","last_active":"2024-04-17T02:22:23.245156+0000","last_peered":"2024-04-17T02:22:23.245156+0000","last_clean":"2024-04-17T02:22:23.245156+0000","last_became_active":"2024-04-17T02:22:22.253756+0000","last_became_peered":"2024-04-17T02:22:22.253756+0000","last_unstale":"2024-04-17T02:22:23.245156+0000","last_undegraded":"2024-04-17T02:22:23.245156+0000","last_fullsized":"2024-04-17T02:22:23.245156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:55:12.334737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.244837+0000","last_change":"2024-04-17T02:22:22.269407+0000","last_active":"2024-04-17T02:22:23.244837+0000","last_peered":"2024-04-17T02:22:23.244837+0000","last_clean":"2024-04-17T02:22:23.244837+0000","last_became_active":"2024-04-17T02:22:22.269130+0000","last_became_peered":"2024-04-17T02:22:22.269130+0000","last_unstale":"2024-04-17T02:22:23.244837+0000","last_undegraded":"2024-04-17T02:22:23.244837+0000","last_fullsized":"2024-04-17T02:22:23.244837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:44:17.761493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.244638+0000","last_change":"2024-04-17T02:22:22.257257+0000","last_active":"2024-04-17T02:22:23.244638+0000","last_peered":"2024-04-17T02:22:23.244638+0000","last_clean":"2024-04-17T02:22:23.244638+0000","last_became_active":"2024-04-17T02:22:22.256498+0000","last_became_peered":"2024-04-17T02:22:22.256498+0000","last_unstale":"2024-04-17T02:22:23.244638+0000","last_undegraded":"2024-04-17T02:22:23.244638+0000","last_fullsized":"2024-04-17T02:22:23.244638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:09:57.616528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963373+0000","last_change":"2024-04-17T02:22:22.273771+0000","last_active":"2024-04-17T02:22:23.963373+0000","last_peered":"2024-04-17T02:22:23.963373+0000","last_clean":"2024-04-17T02:22:23.963373+0000","last_became_active":"2024-04-17T02:22:22.273403+0000","last_became_peered":"2024-04-17T02:22:22.273403+0000","last_unstale":"2024-04-17T02:22:23.963373+0000","last_undegraded":"2024-04-17T02:22:23.963373+0000","last_fullsized":"2024-04-17T02:22:23.963373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:43:59.776760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248116+0000","last_change":"2024-04-17T02:22:22.258817+0000","last_active":"2024-04-17T02:22:23.248116+0000","last_peered":"2024-04-17T02:22:23.248116+0000","last_clean":"2024-04-17T02:22:23.248116+0000","last_became_active":"2024-04-17T02:22:22.258461+0000","last_became_peered":"2024-04-17T02:22:22.258461+0000","last_unstale":"2024-04-17T02:22:23.248116+0000","last_undegraded":"2024-04-17T02:22:23.248116+0000","last_fullsized":"2024-04-17T02:22:23.248116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:24:39.123134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246891+0000","last_change":"2024-04-17T02:22:22.260864+0000","last_active":"2024-04-17T02:22:23.246891+0000","last_peered":"2024-04-17T02:22:23.246891+0000","last_clean":"2024-04-17T02:22:23.246891+0000","last_became_active":"2024-04-17T02:22:22.260605+0000","last_became_peered":"2024-04-17T02:22:22.260605+0000","last_unstale":"2024-04-17T02:22:23.246891+0000","last_undegraded":"2024-04-17T02:22:23.246891+0000","last_fullsized":"2024-04-17T02:22:23.246891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:24:43.421842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962806+0000","last_change":"2024-04-17T02:22:22.271849+0000","last_active":"2024-04-17T02:22:23.962806+0000","last_peered":"2024-04-17T02:22:23.962806+0000","last_clean":"2024-04-17T02:22:23.962806+0000","last_became_active":"2024-04-17T02:22:22.270030+0000","last_became_peered":"2024-04-17T02:22:22.270030+0000","last_unstale":"2024-04-17T02:22:23.962806+0000","last_undegraded":"2024-04-17T02:22:23.962806+0000","last_fullsized":"2024-04-17T02:22:23.962806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:26:13.695328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245164+0000","last_change":"2024-04-17T02:22:22.255249+0000","last_active":"2024-04-17T02:22:23.245164+0000","last_peered":"2024-04-17T02:22:23.245164+0000","last_clean":"2024-04-17T02:22:23.245164+0000","last_became_active":"2024-04-17T02:22:22.254964+0000","last_became_peered":"2024-04-17T02:22:22.254964+0000","last_unstale":"2024-04-17T02:22:23.245164+0000","last_undegraded":"2024-04-17T02:22:23.245164+0000","last_fullsized":"2024-04-17T02:22:23.245164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:08:08.804961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962272+0000","last_change":"2024-04-17T02:22:22.277803+0000","last_active":"2024-04-17T02:22:23.962272+0000","last_peered":"2024-04-17T02:22:23.962272+0000","last_clean":"2024-04-17T02:22:23.962272+0000","last_became_active":"2024-04-17T02:22:22.277509+0000","last_became_peered":"2024-04-17T02:22:22.277509+0000","last_unstale":"2024-04-17T02:22:23.962272+0000","last_undegraded":"2024-04-17T02:22:23.962272+0000","last_fullsized":"2024-04-17T02:22:23.962272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:40:01.962151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248329+0000","last_change":"2024-04-17T02:22:22.274201+0000","last_active":"2024-04-17T02:22:23.248329+0000","last_peered":"2024-04-17T02:22:23.248329+0000","last_clean":"2024-04-17T02:22:23.248329+0000","last_became_active":"2024-04-17T02:22:22.273832+0000","last_became_peered":"2024-04-17T02:22:22.273832+0000","last_unstale":"2024-04-17T02:22:23.248329+0000","last_undegraded":"2024-04-17T02:22:23.248329+0000","last_fullsized":"2024-04-17T02:22:23.248329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:45:41.860323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.244683+0000","last_change":"2024-04-17T02:22:22.250494+0000","last_active":"2024-04-17T02:22:23.244683+0000","last_peered":"2024-04-17T02:22:23.244683+0000","last_clean":"2024-04-17T02:22:23.244683+0000","last_became_active":"2024-04-17T02:22:22.250080+0000","last_became_peered":"2024-04-17T02:22:22.250080+0000","last_unstale":"2024-04-17T02:22:23.244683+0000","last_undegraded":"2024-04-17T02:22:23.244683+0000","last_fullsized":"2024-04-17T02:22:23.244683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:35:24.036979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963005+0000","last_change":"2024-04-17T02:22:22.274842+0000","last_active":"2024-04-17T02:22:23.963005+0000","last_peered":"2024-04-17T02:22:23.963005+0000","last_clean":"2024-04-17T02:22:23.963005+0000","last_became_active":"2024-04-17T02:22:22.273726+0000","last_became_peered":"2024-04-17T02:22:22.273726+0000","last_unstale":"2024-04-17T02:22:23.963005+0000","last_undegraded":"2024-04-17T02:22:23.963005+0000","last_fullsized":"2024-04-17T02:22:23.963005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:45:35.746928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963211+0000","last_change":"2024-04-17T02:22:22.273623+0000","last_active":"2024-04-17T02:22:23.963211+0000","last_peered":"2024-04-17T02:22:23.963211+0000","last_clean":"2024-04-17T02:22:23.963211+0000","last_became_active":"2024-04-17T02:22:22.273324+0000","last_became_peered":"2024-04-17T02:22:22.273324+0000","last_unstale":"2024-04-17T02:22:23.963211+0000","last_undegraded":"2024-04-17T02:22:23.963211+0000","last_fullsized":"2024-04-17T02:22:23.963211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:55:12.334737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246237+0000","last_change":"2024-04-17T02:22:22.259990+0000","last_active":"2024-04-17T02:22:23.246237+0000","last_peered":"2024-04-17T02:22:23.246237+0000","last_clean":"2024-04-17T02:22:23.246237+0000","last_became_active":"2024-04-17T02:22:22.259635+0000","last_became_peered":"2024-04-17T02:22:22.259635+0000","last_unstale":"2024-04-17T02:22:23.246237+0000","last_undegraded":"2024-04-17T02:22:23.246237+0000","last_fullsized":"2024-04-17T02:22:23.246237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:38:51.312268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963321+0000","last_change":"2024-04-17T02:22:22.269783+0000","last_active":"2024-04-17T02:22:23.963321+0000","last_peered":"2024-04-17T02:22:23.963321+0000","last_clean":"2024-04-17T02:22:23.963321+0000","last_became_active":"2024-04-17T02:22:22.269006+0000","last_became_peered":"2024-04-17T02:22:22.269006+0000","last_unstale":"2024-04-17T02:22:23.963321+0000","last_undegraded":"2024-04-17T02:22:23.963321+0000","last_fullsized":"2024-04-17T02:22:23.963321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:08:08.804961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248147+0000","last_change":"2024-04-17T02:22:22.258194+0000","last_active":"2024-04-17T02:22:23.248147+0000","last_peered":"2024-04-17T02:22:23.248147+0000","last_clean":"2024-04-17T02:22:23.248147+0000","last_became_active":"2024-04-17T02:22:22.257344+0000","last_became_peered":"2024-04-17T02:22:22.257344+0000","last_unstale":"2024-04-17T02:22:23.248147+0000","last_undegraded":"2024-04-17T02:22:23.248147+0000","last_fullsized":"2024-04-17T02:22:23.248147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:12:23.134715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962539+0000","last_change":"2024-04-17T02:22:22.276867+0000","last_active":"2024-04-17T02:22:23.962539+0000","last_peered":"2024-04-17T02:22:23.962539+0000","last_clean":"2024-04-17T02:22:23.962539+0000","last_became_active":"2024-04-17T02:22:22.273911+0000","last_became_peered":"2024-04-17T02:22:22.273911+0000","last_unstale":"2024-04-17T02:22:23.962539+0000","last_undegraded":"2024-04-17T02:22:23.962539+0000","last_fullsized":"2024-04-17T02:22:23.962539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:12:23.134715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248369+0000","last_change":"2024-04-17T02:22:22.274573+0000","last_active":"2024-04-17T02:22:23.248369+0000","last_peered":"2024-04-17T02:22:23.248369+0000","last_clean":"2024-04-17T02:22:23.248369+0000","last_became_active":"2024-04-17T02:22:22.274287+0000","last_became_peered":"2024-04-17T02:22:22.274287+0000","last_unstale":"2024-04-17T02:22:23.248369+0000","last_undegraded":"2024-04-17T02:22:23.248369+0000","last_fullsized":"2024-04-17T02:22:23.248369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:02:38.660756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.244774+0000","last_change":"2024-04-17T02:22:22.249744+0000","last_active":"2024-04-17T02:22:23.244774+0000","last_peered":"2024-04-17T02:22:23.244774+0000","last_clean":"2024-04-17T02:22:23.244774+0000","last_became_active":"2024-04-17T02:22:22.249456+0000","last_became_peered":"2024-04-17T02:22:22.249456+0000","last_unstale":"2024-04-17T02:22:23.244774+0000","last_undegraded":"2024-04-17T02:22:23.244774+0000","last_fullsized":"2024-04-17T02:22:23.244774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:58:55.176237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247534+0000","last_change":"2024-04-17T02:22:22.276822+0000","last_active":"2024-04-17T02:22:23.247534+0000","last_peered":"2024-04-17T02:22:23.247534+0000","last_clean":"2024-04-17T02:22:23.247534+0000","last_became_active":"2024-04-17T02:22:22.276565+0000","last_became_peered":"2024-04-17T02:22:22.276565+0000","last_unstale":"2024-04-17T02:22:23.247534+0000","last_undegraded":"2024-04-17T02:22:23.247534+0000","last_fullsized":"2024-04-17T02:22:23.247534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:00:17.976771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248519+0000","last_change":"2024-04-17T02:22:21.260392+0000","last_active":"2024-04-17T02:22:23.248519+0000","last_peered":"2024-04-17T02:22:23.248519+0000","last_clean":"2024-04-17T02:22:23.248519+0000","last_became_active":"2024-04-17T02:22:21.259347+0000","last_became_peered":"2024-04-17T02:22:21.259347+0000","last_unstale":"2024-04-17T02:22:23.248519+0000","last_undegraded":"2024-04-17T02:22:23.248519+0000","last_fullsized":"2024-04-17T02:22:23.248519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:07:12.265185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248186+0000","last_change":"2024-04-17T02:22:22.260150+0000","last_active":"2024-04-17T02:22:23.248186+0000","last_peered":"2024-04-17T02:22:23.248186+0000","last_clean":"2024-04-17T02:22:23.248186+0000","last_became_active":"2024-04-17T02:22:22.259875+0000","last_became_peered":"2024-04-17T02:22:22.259875+0000","last_unstale":"2024-04-17T02:22:23.248186+0000","last_undegraded":"2024-04-17T02:22:23.248186+0000","last_fullsized":"2024-04-17T02:22:23.248186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:59:56.366536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246343+0000","last_change":"2024-04-17T02:22:21.252345+0000","last_active":"2024-04-17T02:22:23.246343+0000","last_peered":"2024-04-17T02:22:23.246343+0000","last_clean":"2024-04-17T02:22:23.246343+0000","last_became_active":"2024-04-17T02:22:21.252035+0000","last_became_peered":"2024-04-17T02:22:21.252035+0000","last_unstale":"2024-04-17T02:22:23.246343+0000","last_undegraded":"2024-04-17T02:22:23.246343+0000","last_fullsized":"2024-04-17T02:22:23.246343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:00:58.747974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248224+0000","last_change":"2024-04-17T02:22:22.277830+0000","last_active":"2024-04-17T02:22:23.248224+0000","last_peered":"2024-04-17T02:22:23.248224+0000","last_clean":"2024-04-17T02:22:23.248224+0000","last_became_active":"2024-04-17T02:22:22.277558+0000","last_became_peered":"2024-04-17T02:22:22.277558+0000","last_unstale":"2024-04-17T02:22:23.248224+0000","last_undegraded":"2024-04-17T02:22:23.248224+0000","last_fullsized":"2024-04-17T02:22:23.248224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:06:11.399207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.244931+0000","last_change":"2024-04-17T02:22:21.257436+0000","last_active":"2024-04-17T02:22:23.244931+0000","last_peered":"2024-04-17T02:22:23.244931+0000","last_clean":"2024-04-17T02:22:23.244931+0000","last_became_active":"2024-04-17T02:22:21.256912+0000","last_became_peered":"2024-04-17T02:22:21.256912+0000","last_unstale":"2024-04-17T02:22:23.244931+0000","last_undegraded":"2024-04-17T02:22:23.244931+0000","last_fullsized":"2024-04-17T02:22:23.244931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:24:42.419846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248533+0000","last_change":"2024-04-17T02:22:22.278083+0000","last_active":"2024-04-17T02:22:23.248533+0000","last_peered":"2024-04-17T02:22:23.248533+0000","last_clean":"2024-04-17T02:22:23.248533+0000","last_became_active":"2024-04-17T02:22:22.277838+0000","last_became_peered":"2024-04-17T02:22:22.277838+0000","last_unstale":"2024-04-17T02:22:23.248533+0000","last_undegraded":"2024-04-17T02:22:23.248533+0000","last_fullsized":"2024-04-17T02:22:23.248533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:28:17.292009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.244776+0000","last_change":"2024-04-17T02:22:21.264203+0000","last_active":"2024-04-17T02:22:23.244776+0000","last_peered":"2024-04-17T02:22:23.244776+0000","last_clean":"2024-04-17T02:22:23.244776+0000","last_became_active":"2024-04-17T02:22:21.263926+0000","last_became_peered":"2024-04-17T02:22:21.263926+0000","last_unstale":"2024-04-17T02:22:23.244776+0000","last_undegraded":"2024-04-17T02:22:23.244776+0000","last_fullsized":"2024-04-17T02:22:23.244776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:12:51.802467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245897+0000","last_change":"2024-04-17T02:22:21.262253+0000","last_active":"2024-04-17T02:22:23.245897+0000","last_peered":"2024-04-17T02:22:23.245897+0000","last_clean":"2024-04-17T02:22:23.245897+0000","last_became_active":"2024-04-17T02:22:21.261336+0000","last_became_peered":"2024-04-17T02:22:21.261336+0000","last_unstale":"2024-04-17T02:22:23.245897+0000","last_undegraded":"2024-04-17T02:22:23.245897+0000","last_fullsized":"2024-04-17T02:22:23.245897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:20:13.640602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247204+0000","last_change":"2024-04-17T02:22:22.259672+0000","last_active":"2024-04-17T02:22:23.247204+0000","last_peered":"2024-04-17T02:22:23.247204+0000","last_clean":"2024-04-17T02:22:23.247204+0000","last_became_active":"2024-04-17T02:22:22.259407+0000","last_became_peered":"2024-04-17T02:22:22.259407+0000","last_unstale":"2024-04-17T02:22:23.247204+0000","last_undegraded":"2024-04-17T02:22:23.247204+0000","last_fullsized":"2024-04-17T02:22:23.247204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:56:41.058446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246089+0000","last_change":"2024-04-17T02:22:21.251579+0000","last_active":"2024-04-17T02:22:23.246089+0000","last_peered":"2024-04-17T02:22:23.246089+0000","last_clean":"2024-04-17T02:22:23.246089+0000","last_became_active":"2024-04-17T02:22:21.251330+0000","last_became_peered":"2024-04-17T02:22:21.251330+0000","last_unstale":"2024-04-17T02:22:23.246089+0000","last_undegraded":"2024-04-17T02:22:23.246089+0000","last_fullsized":"2024-04-17T02:22:23.246089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:30:22.630029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962294+0000","last_change":"2024-04-17T02:22:22.270839+0000","last_active":"2024-04-17T02:22:23.962294+0000","last_peered":"2024-04-17T02:22:23.962294+0000","last_clean":"2024-04-17T02:22:23.962294+0000","last_became_active":"2024-04-17T02:22:22.268977+0000","last_became_peered":"2024-04-17T02:22:22.268977+0000","last_unstale":"2024-04-17T02:22:23.962294+0000","last_undegraded":"2024-04-17T02:22:23.962294+0000","last_fullsized":"2024-04-17T02:22:23.962294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:07:20.363260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246033+0000","last_change":"2024-04-17T02:22:21.256996+0000","last_active":"2024-04-17T02:22:23.246033+0000","last_peered":"2024-04-17T02:22:23.246033+0000","last_clean":"2024-04-17T02:22:23.246033+0000","last_became_active":"2024-04-17T02:22:21.256082+0000","last_became_peered":"2024-04-17T02:22:21.256082+0000","last_unstale":"2024-04-17T02:22:23.246033+0000","last_undegraded":"2024-04-17T02:22:23.246033+0000","last_fullsized":"2024-04-17T02:22:23.246033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:42:14.419225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245472+0000","last_change":"2024-04-17T02:22:22.258273+0000","last_active":"2024-04-17T02:22:23.245472+0000","last_peered":"2024-04-17T02:22:23.245472+0000","last_clean":"2024-04-17T02:22:23.245472+0000","last_became_active":"2024-04-17T02:22:22.257818+0000","last_became_peered":"2024-04-17T02:22:22.257818+0000","last_unstale":"2024-04-17T02:22:23.245472+0000","last_undegraded":"2024-04-17T02:22:23.245472+0000","last_fullsized":"2024-04-17T02:22:23.245472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:45:43.904195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245616+0000","last_change":"2024-04-17T02:22:21.250003+0000","last_active":"2024-04-17T02:22:23.245616+0000","last_peered":"2024-04-17T02:22:23.245616+0000","last_clean":"2024-04-17T02:22:23.245616+0000","last_became_active":"2024-04-17T02:22:21.249709+0000","last_became_peered":"2024-04-17T02:22:21.249709+0000","last_unstale":"2024-04-17T02:22:23.245616+0000","last_undegraded":"2024-04-17T02:22:23.245616+0000","last_fullsized":"2024-04-17T02:22:23.245616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:56:40.377974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246786+0000","last_change":"2024-04-17T02:22:22.255008+0000","last_active":"2024-04-17T02:22:23.246786+0000","last_peered":"2024-04-17T02:22:23.246786+0000","last_clean":"2024-04-17T02:22:23.246786+0000","last_became_active":"2024-04-17T02:22:22.254689+0000","last_became_peered":"2024-04-17T02:22:22.254689+0000","last_unstale":"2024-04-17T02:22:23.246786+0000","last_undegraded":"2024-04-17T02:22:23.246786+0000","last_fullsized":"2024-04-17T02:22:23.246786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:05:18.321177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248616+0000","last_change":"2024-04-17T02:22:21.265269+0000","last_active":"2024-04-17T02:22:23.248616+0000","last_peered":"2024-04-17T02:22:23.248616+0000","last_clean":"2024-04-17T02:22:23.248616+0000","last_became_active":"2024-04-17T02:22:21.264981+0000","last_became_peered":"2024-04-17T02:22:21.264981+0000","last_unstale":"2024-04-17T02:22:23.248616+0000","last_undegraded":"2024-04-17T02:22:23.248616+0000","last_fullsized":"2024-04-17T02:22:23.248616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:27:52.759868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962935+0000","last_change":"2024-04-17T02:22:22.271981+0000","last_active":"2024-04-17T02:22:23.962935+0000","last_peered":"2024-04-17T02:22:23.962935+0000","last_clean":"2024-04-17T02:22:23.962935+0000","last_became_active":"2024-04-17T02:22:22.270317+0000","last_became_peered":"2024-04-17T02:22:22.270317+0000","last_unstale":"2024-04-17T02:22:23.962935+0000","last_undegraded":"2024-04-17T02:22:23.962935+0000","last_fullsized":"2024-04-17T02:22:23.962935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:02:38.660756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245901+0000","last_change":"2024-04-17T02:22:21.262438+0000","last_active":"2024-04-17T02:22:23.245901+0000","last_peered":"2024-04-17T02:22:23.245901+0000","last_clean":"2024-04-17T02:22:23.245901+0000","last_became_active":"2024-04-17T02:22:21.261470+0000","last_became_peered":"2024-04-17T02:22:21.261470+0000","last_unstale":"2024-04-17T02:22:23.245901+0000","last_undegraded":"2024-04-17T02:22:23.245901+0000","last_fullsized":"2024-04-17T02:22:23.245901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:22:02.248276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245775+0000","last_change":"2024-04-17T02:22:22.255994+0000","last_active":"2024-04-17T02:22:23.245775+0000","last_peered":"2024-04-17T02:22:23.245775+0000","last_clean":"2024-04-17T02:22:23.245775+0000","last_became_active":"2024-04-17T02:22:22.255089+0000","last_became_peered":"2024-04-17T02:22:22.255089+0000","last_unstale":"2024-04-17T02:22:23.245775+0000","last_undegraded":"2024-04-17T02:22:23.245775+0000","last_fullsized":"2024-04-17T02:22:23.245775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:50:00.777691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248497+0000","last_change":"2024-04-17T02:22:21.259659+0000","last_active":"2024-04-17T02:22:23.248497+0000","last_peered":"2024-04-17T02:22:23.248497+0000","last_clean":"2024-04-17T02:22:23.248497+0000","last_became_active":"2024-04-17T02:22:21.259030+0000","last_became_peered":"2024-04-17T02:22:21.259030+0000","last_unstale":"2024-04-17T02:22:23.248497+0000","last_undegraded":"2024-04-17T02:22:23.248497+0000","last_fullsized":"2024-04-17T02:22:23.248497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:43:22.970177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247238+0000","last_change":"2024-04-17T02:22:22.254414+0000","last_active":"2024-04-17T02:22:23.247238+0000","last_peered":"2024-04-17T02:22:23.247238+0000","last_clean":"2024-04-17T02:22:23.247238+0000","last_became_active":"2024-04-17T02:22:22.253963+0000","last_became_peered":"2024-04-17T02:22:22.253963+0000","last_unstale":"2024-04-17T02:22:23.247238+0000","last_undegraded":"2024-04-17T02:22:23.247238+0000","last_fullsized":"2024-04-17T02:22:23.247238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:56:41.379971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247417+0000","last_change":"2024-04-17T02:22:21.266419+0000","last_active":"2024-04-17T02:22:23.247417+0000","last_peered":"2024-04-17T02:22:23.247417+0000","last_clean":"2024-04-17T02:22:23.247417+0000","last_became_active":"2024-04-17T02:22:21.266123+0000","last_became_peered":"2024-04-17T02:22:21.266123+0000","last_unstale":"2024-04-17T02:22:23.247417+0000","last_undegraded":"2024-04-17T02:22:23.247417+0000","last_fullsized":"2024-04-17T02:22:23.247417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:06:57.393992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963114+0000","last_change":"2024-04-17T02:22:22.277085+0000","last_active":"2024-04-17T02:22:23.963114+0000","last_peered":"2024-04-17T02:22:23.963114+0000","last_clean":"2024-04-17T02:22:23.963114+0000","last_became_active":"2024-04-17T02:22:22.275396+0000","last_became_peered":"2024-04-17T02:22:22.275396+0000","last_unstale":"2024-04-17T02:22:23.963114+0000","last_undegraded":"2024-04-17T02:22:23.963114+0000","last_fullsized":"2024-04-17T02:22:23.963114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:35:24.036979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":176,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962291+0000","last_change":"2024-04-17T02:22:12.100529+0000","last_active":"2024-04-17T02:22:23.962291+0000","last_peered":"2024-04-17T02:22:23.962291+0000","last_clean":"2024-04-17T02:22:23.962291+0000","last_became_active":"2024-04-17T02:22:12.100191+0000","last_became_peered":"2024-04-17T02:22:12.100191+0000","last_unstale":"2024-04-17T02:22:23.962291+0000","last_undegraded":"2024-04-17T02:22:23.962291+0000","last_fullsized":"2024-04-17T02:22:23.962291+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:11.088733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:11.088733+0000","last_clean_scrub_stamp":"2024-04-17T02:22:11.088733+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:47:32.959035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245357+0000","last_change":"2024-04-17T02:22:17.123965+0000","last_active":"2024-04-17T02:22:23.245357+0000","last_peered":"2024-04-17T02:22:23.245357+0000","last_clean":"2024-04-17T02:22:23.245357+0000","last_became_active":"2024-04-17T02:22:17.123282+0000","last_became_peered":"2024-04-17T02:22:17.123282+0000","last_unstale":"2024-04-17T02:22:23.245357+0000","last_undegraded":"2024-04-17T02:22:23.245357+0000","last_fullsized":"2024-04-17T02:22:23.245357+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:00:54.621590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247944+0000","last_change":"2024-04-17T02:22:21.259046+0000","last_active":"2024-04-17T02:22:23.247944+0000","last_peered":"2024-04-17T02:22:23.247944+0000","last_clean":"2024-04-17T02:22:23.247944+0000","last_became_active":"2024-04-17T02:22:21.258750+0000","last_became_peered":"2024-04-17T02:22:21.258750+0000","last_unstale":"2024-04-17T02:22:23.247944+0000","last_undegraded":"2024-04-17T02:22:23.247944+0000","last_fullsized":"2024-04-17T02:22:23.247944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:21:58.622774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246098+0000","last_change":"2024-04-17T02:22:22.256960+0000","last_active":"2024-04-17T02:22:23.246098+0000","last_peered":"2024-04-17T02:22:23.246098+0000","last_clean":"2024-04-17T02:22:23.246098+0000","last_became_active":"2024-04-17T02:22:22.256613+0000","last_became_peered":"2024-04-17T02:22:22.256613+0000","last_unstale":"2024-04-17T02:22:23.246098+0000","last_undegraded":"2024-04-17T02:22:23.246098+0000","last_fullsized":"2024-04-17T02:22:23.246098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:32:56.166132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.244846+0000","last_change":"2024-04-17T02:22:17.123918+0000","last_active":"2024-04-17T02:22:23.244846+0000","last_peered":"2024-04-17T02:22:23.244846+0000","last_clean":"2024-04-17T02:22:23.244846+0000","last_became_active":"2024-04-17T02:22:17.123423+0000","last_became_peered":"2024-04-17T02:22:17.123423+0000","last_unstale":"2024-04-17T02:22:23.244846+0000","last_undegraded":"2024-04-17T02:22:23.244846+0000","last_fullsized":"2024-04-17T02:22:23.244846+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:25:53.024970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962441+0000","last_change":"2024-04-17T02:22:21.260085+0000","last_active":"2024-04-17T02:22:23.962441+0000","last_peered":"2024-04-17T02:22:23.962441+0000","last_clean":"2024-04-17T02:22:23.962441+0000","last_became_active":"2024-04-17T02:22:21.259738+0000","last_became_peered":"2024-04-17T02:22:21.259738+0000","last_unstale":"2024-04-17T02:22:23.962441+0000","last_undegraded":"2024-04-17T02:22:23.962441+0000","last_fullsized":"2024-04-17T02:22:23.962441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:34:47.001187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247930+0000","last_change":"2024-04-17T02:22:22.276216+0000","last_active":"2024-04-17T02:22:23.247930+0000","last_peered":"2024-04-17T02:22:23.247930+0000","last_clean":"2024-04-17T02:22:23.247930+0000","last_became_active":"2024-04-17T02:22:22.275925+0000","last_became_peered":"2024-04-17T02:22:22.275925+0000","last_unstale":"2024-04-17T02:22:23.247930+0000","last_undegraded":"2024-04-17T02:22:23.247930+0000","last_fullsized":"2024-04-17T02:22:23.247930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:12:02.539603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247214+0000","last_change":"2024-04-17T02:22:17.560526+0000","last_active":"2024-04-17T02:22:23.247214+0000","last_peered":"2024-04-17T02:22:23.247214+0000","last_clean":"2024-04-17T02:22:23.247214+0000","last_became_active":"2024-04-17T02:22:17.560120+0000","last_became_peered":"2024-04-17T02:22:17.560120+0000","last_unstale":"2024-04-17T02:22:23.247214+0000","last_undegraded":"2024-04-17T02:22:23.247214+0000","last_fullsized":"2024-04-17T02:22:23.247214+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:49:30.975553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962096+0000","last_change":"2024-04-17T02:22:21.265155+0000","last_active":"2024-04-17T02:22:23.962096+0000","last_peered":"2024-04-17T02:22:23.962096+0000","last_clean":"2024-04-17T02:22:23.962096+0000","last_became_active":"2024-04-17T02:22:21.263791+0000","last_became_peered":"2024-04-17T02:22:21.263791+0000","last_unstale":"2024-04-17T02:22:23.962096+0000","last_undegraded":"2024-04-17T02:22:23.962096+0000","last_fullsized":"2024-04-17T02:22:23.962096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:29:08.387822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963208+0000","last_change":"2024-04-17T02:22:22.275017+0000","last_active":"2024-04-17T02:22:23.963208+0000","last_peered":"2024-04-17T02:22:23.963208+0000","last_clean":"2024-04-17T02:22:23.963208+0000","last_became_active":"2024-04-17T02:22:22.273465+0000","last_became_peered":"2024-04-17T02:22:22.273465+0000","last_unstale":"2024-04-17T02:22:23.963208+0000","last_undegraded":"2024-04-17T02:22:23.963208+0000","last_fullsized":"2024-04-17T02:22:23.963208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:44:17.761493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245862+0000","last_change":"2024-04-17T02:22:17.123761+0000","last_active":"2024-04-17T02:22:23.245862+0000","last_peered":"2024-04-17T02:22:23.245862+0000","last_clean":"2024-04-17T02:22:23.245862+0000","last_became_active":"2024-04-17T02:22:17.123264+0000","last_became_peered":"2024-04-17T02:22:17.123264+0000","last_unstale":"2024-04-17T02:22:23.245862+0000","last_undegraded":"2024-04-17T02:22:23.245862+0000","last_fullsized":"2024-04-17T02:22:23.245862+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:51:28.918451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245315+0000","last_change":"2024-04-17T02:22:21.262295+0000","last_active":"2024-04-17T02:22:23.245315+0000","last_peered":"2024-04-17T02:22:23.245315+0000","last_clean":"2024-04-17T02:22:23.245315+0000","last_became_active":"2024-04-17T02:22:21.261890+0000","last_became_peered":"2024-04-17T02:22:21.261890+0000","last_unstale":"2024-04-17T02:22:23.245315+0000","last_undegraded":"2024-04-17T02:22:23.245315+0000","last_fullsized":"2024-04-17T02:22:23.245315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:31:33.861752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963136+0000","last_change":"2024-04-17T02:22:22.275199+0000","last_active":"2024-04-17T02:22:23.963136+0000","last_peered":"2024-04-17T02:22:23.963136+0000","last_clean":"2024-04-17T02:22:23.963136+0000","last_became_active":"2024-04-17T02:22:22.274892+0000","last_became_peered":"2024-04-17T02:22:22.274892+0000","last_unstale":"2024-04-17T02:22:23.963136+0000","last_undegraded":"2024-04-17T02:22:23.963136+0000","last_fullsized":"2024-04-17T02:22:23.963136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:58:55.176237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246122+0000","last_change":"2024-04-17T02:22:21.256839+0000","last_active":"2024-04-17T02:22:23.246122+0000","last_peered":"2024-04-17T02:22:23.246122+0000","last_clean":"2024-04-17T02:22:23.246122+0000","last_became_active":"2024-04-17T02:22:21.255764+0000","last_became_peered":"2024-04-17T02:22:21.255764+0000","last_unstale":"2024-04-17T02:22:23.246122+0000","last_undegraded":"2024-04-17T02:22:23.246122+0000","last_fullsized":"2024-04-17T02:22:23.246122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:05:15.621470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963324+0000","last_change":"2024-04-17T02:22:17.560478+0000","last_active":"2024-04-17T02:22:23.963324+0000","last_peered":"2024-04-17T02:22:23.963324+0000","last_clean":"2024-04-17T02:22:23.963324+0000","last_became_active":"2024-04-17T02:22:17.560133+0000","last_became_peered":"2024-04-17T02:22:17.560133+0000","last_unstale":"2024-04-17T02:22:23.963324+0000","last_undegraded":"2024-04-17T02:22:23.963324+0000","last_fullsized":"2024-04-17T02:22:23.963324+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:36:01.410663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962278+0000","last_change":"2024-04-17T02:22:22.277210+0000","last_active":"2024-04-17T02:22:23.962278+0000","last_peered":"2024-04-17T02:22:23.962278+0000","last_clean":"2024-04-17T02:22:23.962278+0000","last_became_active":"2024-04-17T02:22:22.275055+0000","last_became_peered":"2024-04-17T02:22:22.275055+0000","last_unstale":"2024-04-17T02:22:23.962278+0000","last_undegraded":"2024-04-17T02:22:23.962278+0000","last_fullsized":"2024-04-17T02:22:23.962278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:59:56.366536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963255+0000","last_change":"2024-04-17T02:22:21.259328+0000","last_active":"2024-04-17T02:22:23.963255+0000","last_peered":"2024-04-17T02:22:23.963255+0000","last_clean":"2024-04-17T02:22:23.963255+0000","last_became_active":"2024-04-17T02:22:21.259133+0000","last_became_peered":"2024-04-17T02:22:21.259133+0000","last_unstale":"2024-04-17T02:22:23.963255+0000","last_undegraded":"2024-04-17T02:22:23.963255+0000","last_fullsized":"2024-04-17T02:22:23.963255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:36:10.793622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246164+0000","last_change":"2024-04-17T02:22:17.124496+0000","last_active":"2024-04-17T02:22:23.246164+0000","last_peered":"2024-04-17T02:22:23.246164+0000","last_clean":"2024-04-17T02:22:23.246164+0000","last_became_active":"2024-04-17T02:22:17.123440+0000","last_became_peered":"2024-04-17T02:22:17.123440+0000","last_unstale":"2024-04-17T02:22:23.246164+0000","last_undegraded":"2024-04-17T02:22:23.246164+0000","last_fullsized":"2024-04-17T02:22:23.246164+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:29:11.971454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962511+0000","last_change":"2024-04-17T02:22:22.268601+0000","last_active":"2024-04-17T02:22:23.962511+0000","last_peered":"2024-04-17T02:22:23.962511+0000","last_clean":"2024-04-17T02:22:23.962511+0000","last_became_active":"2024-04-17T02:22:22.267752+0000","last_became_peered":"2024-04-17T02:22:22.267752+0000","last_unstale":"2024-04-17T02:22:23.962511+0000","last_undegraded":"2024-04-17T02:22:23.962511+0000","last_fullsized":"2024-04-17T02:22:23.962511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:24:39.123134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248403+0000","last_change":"2024-04-17T02:22:21.265332+0000","last_active":"2024-04-17T02:22:23.248403+0000","last_peered":"2024-04-17T02:22:23.248403+0000","last_clean":"2024-04-17T02:22:23.248403+0000","last_became_active":"2024-04-17T02:22:21.265029+0000","last_became_peered":"2024-04-17T02:22:21.265029+0000","last_unstale":"2024-04-17T02:22:23.248403+0000","last_undegraded":"2024-04-17T02:22:23.248403+0000","last_fullsized":"2024-04-17T02:22:23.248403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:34:47.001187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963263+0000","last_change":"2024-04-17T02:22:17.121783+0000","last_active":"2024-04-17T02:22:23.963263+0000","last_peered":"2024-04-17T02:22:23.963263+0000","last_clean":"2024-04-17T02:22:23.963263+0000","last_became_active":"2024-04-17T02:22:17.121502+0000","last_became_peered":"2024-04-17T02:22:17.121502+0000","last_unstale":"2024-04-17T02:22:23.963263+0000","last_undegraded":"2024-04-17T02:22:23.963263+0000","last_fullsized":"2024-04-17T02:22:23.963263+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:05:41.795170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247296+0000","last_change":"2024-04-17T02:22:22.279268+0000","last_active":"2024-04-17T02:22:23.247296+0000","last_peered":"2024-04-17T02:22:23.247296+0000","last_clean":"2024-04-17T02:22:23.247296+0000","last_became_active":"2024-04-17T02:22:22.278986+0000","last_became_peered":"2024-04-17T02:22:22.278986+0000","last_unstale":"2024-04-17T02:22:23.247296+0000","last_undegraded":"2024-04-17T02:22:23.247296+0000","last_fullsized":"2024-04-17T02:22:23.247296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:27:10.507427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:24.246277+0000","last_change":"2024-04-17T02:22:21.261825+0000","last_active":"2024-04-17T02:22:24.246277+0000","last_peered":"2024-04-17T02:22:24.246277+0000","last_clean":"2024-04-17T02:22:24.246277+0000","last_became_active":"2024-04-17T02:22:21.261319+0000","last_became_peered":"2024-04-17T02:22:21.261319+0000","last_unstale":"2024-04-17T02:22:24.246277+0000","last_undegraded":"2024-04-17T02:22:24.246277+0000","last_fullsized":"2024-04-17T02:22:24.246277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:43:22.970177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245937+0000","last_change":"2024-04-17T02:22:17.123744+0000","last_active":"2024-04-17T02:22:23.245937+0000","last_peered":"2024-04-17T02:22:23.245937+0000","last_clean":"2024-04-17T02:22:23.245937+0000","last_became_active":"2024-04-17T02:22:17.123322+0000","last_became_peered":"2024-04-17T02:22:17.123322+0000","last_unstale":"2024-04-17T02:22:23.245937+0000","last_undegraded":"2024-04-17T02:22:23.245937+0000","last_fullsized":"2024-04-17T02:22:23.245937+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:36:41.743830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246504+0000","last_change":"2024-04-17T02:22:22.249162+0000","last_active":"2024-04-17T02:22:23.246504+0000","last_peered":"2024-04-17T02:22:23.246504+0000","last_clean":"2024-04-17T02:22:23.246504+0000","last_became_active":"2024-04-17T02:22:22.248758+0000","last_became_peered":"2024-04-17T02:22:22.248758+0000","last_unstale":"2024-04-17T02:22:23.246504+0000","last_undegraded":"2024-04-17T02:22:23.246504+0000","last_fullsized":"2024-04-17T02:22:23.246504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:18:48.496574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247007+0000","last_change":"2024-04-17T02:22:22.254193+0000","last_active":"2024-04-17T02:22:23.247007+0000","last_peered":"2024-04-17T02:22:23.247007+0000","last_clean":"2024-04-17T02:22:23.247007+0000","last_became_active":"2024-04-17T02:22:22.253786+0000","last_became_peered":"2024-04-17T02:22:22.253786+0000","last_unstale":"2024-04-17T02:22:23.247007+0000","last_undegraded":"2024-04-17T02:22:23.247007+0000","last_fullsized":"2024-04-17T02:22:23.247007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:35:40.664294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245532+0000","last_change":"2024-04-17T02:22:21.248985+0000","last_active":"2024-04-17T02:22:23.245532+0000","last_peered":"2024-04-17T02:22:23.245532+0000","last_clean":"2024-04-17T02:22:23.245532+0000","last_became_active":"2024-04-17T02:22:21.248664+0000","last_became_peered":"2024-04-17T02:22:21.248664+0000","last_unstale":"2024-04-17T02:22:23.245532+0000","last_undegraded":"2024-04-17T02:22:23.245532+0000","last_fullsized":"2024-04-17T02:22:23.245532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:35:39.662298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962584+0000","last_change":"2024-04-17T02:22:22.273634+0000","last_active":"2024-04-17T02:22:23.962584+0000","last_peered":"2024-04-17T02:22:23.962584+0000","last_clean":"2024-04-17T02:22:23.962584+0000","last_became_active":"2024-04-17T02:22:22.273338+0000","last_became_peered":"2024-04-17T02:22:22.273338+0000","last_unstale":"2024-04-17T02:22:23.962584+0000","last_undegraded":"2024-04-17T02:22:23.962584+0000","last_fullsized":"2024-04-17T02:22:23.962584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:06:11.399207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247114+0000","last_change":"2024-04-17T02:22:21.253661+0000","last_active":"2024-04-17T02:22:23.247114+0000","last_peered":"2024-04-17T02:22:23.247114+0000","last_clean":"2024-04-17T02:22:23.247114+0000","last_became_active":"2024-04-17T02:22:21.253375+0000","last_became_peered":"2024-04-17T02:22:21.253375+0000","last_unstale":"2024-04-17T02:22:23.247114+0000","last_undegraded":"2024-04-17T02:22:23.247114+0000","last_fullsized":"2024-04-17T02:22:23.247114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:36:45.870213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245991+0000","last_change":"2024-04-17T02:22:21.261955+0000","last_active":"2024-04-17T02:22:23.245991+0000","last_peered":"2024-04-17T02:22:23.245991+0000","last_clean":"2024-04-17T02:22:23.245991+0000","last_became_active":"2024-04-17T02:22:21.261671+0000","last_became_peered":"2024-04-17T02:22:21.261671+0000","last_unstale":"2024-04-17T02:22:23.245991+0000","last_undegraded":"2024-04-17T02:22:23.245991+0000","last_fullsized":"2024-04-17T02:22:23.245991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:58:48.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248551+0000","last_change":"2024-04-17T02:22:22.259450+0000","last_active":"2024-04-17T02:22:23.248551+0000","last_peered":"2024-04-17T02:22:23.248551+0000","last_clean":"2024-04-17T02:22:23.248551+0000","last_became_active":"2024-04-17T02:22:22.259173+0000","last_became_peered":"2024-04-17T02:22:22.259173+0000","last_unstale":"2024-04-17T02:22:23.248551+0000","last_undegraded":"2024-04-17T02:22:23.248551+0000","last_fullsized":"2024-04-17T02:22:23.248551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:33:01.850142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963409+0000","last_change":"2024-04-17T02:22:21.261243+0000","last_active":"2024-04-17T02:22:23.963409+0000","last_peered":"2024-04-17T02:22:23.963409+0000","last_clean":"2024-04-17T02:22:23.963409+0000","last_became_active":"2024-04-17T02:22:21.260251+0000","last_became_peered":"2024-04-17T02:22:21.260251+0000","last_unstale":"2024-04-17T02:22:23.963409+0000","last_undegraded":"2024-04-17T02:22:23.963409+0000","last_fullsized":"2024-04-17T02:22:23.963409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:04:55.664715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247132+0000","last_change":"2024-04-17T02:22:22.279329+0000","last_active":"2024-04-17T02:22:23.247132+0000","last_peered":"2024-04-17T02:22:23.247132+0000","last_clean":"2024-04-17T02:22:23.247132+0000","last_became_active":"2024-04-17T02:22:22.278952+0000","last_became_peered":"2024-04-17T02:22:22.278952+0000","last_unstale":"2024-04-17T02:22:23.247132+0000","last_undegraded":"2024-04-17T02:22:23.247132+0000","last_fullsized":"2024-04-17T02:22:23.247132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:05:16.623466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245889+0000","last_change":"2024-04-17T02:22:22.259026+0000","last_active":"2024-04-17T02:22:23.245889+0000","last_peered":"2024-04-17T02:22:23.245889+0000","last_clean":"2024-04-17T02:22:23.245889+0000","last_became_active":"2024-04-17T02:22:22.258727+0000","last_became_peered":"2024-04-17T02:22:22.258727+0000","last_unstale":"2024-04-17T02:22:23.245889+0000","last_undegraded":"2024-04-17T02:22:23.245889+0000","last_fullsized":"2024-04-17T02:22:23.245889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:49:55.581353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247317+0000","last_change":"2024-04-17T02:22:21.266400+0000","last_active":"2024-04-17T02:22:23.247317+0000","last_peered":"2024-04-17T02:22:23.247317+0000","last_clean":"2024-04-17T02:22:23.247317+0000","last_became_active":"2024-04-17T02:22:21.266106+0000","last_became_peered":"2024-04-17T02:22:21.266106+0000","last_unstale":"2024-04-17T02:22:23.247317+0000","last_undegraded":"2024-04-17T02:22:23.247317+0000","last_fullsized":"2024-04-17T02:22:23.247317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:17:38.056686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963025+0000","last_change":"2024-04-17T02:22:22.275393+0000","last_active":"2024-04-17T02:22:23.963025+0000","last_peered":"2024-04-17T02:22:23.963025+0000","last_clean":"2024-04-17T02:22:23.963025+0000","last_became_active":"2024-04-17T02:22:22.273656+0000","last_became_peered":"2024-04-17T02:22:22.273656+0000","last_unstale":"2024-04-17T02:22:23.963025+0000","last_undegraded":"2024-04-17T02:22:23.963025+0000","last_fullsized":"2024-04-17T02:22:23.963025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:09:57.616528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962374+0000","last_change":"2024-04-17T02:22:21.263049+0000","last_active":"2024-04-17T02:22:23.962374+0000","last_peered":"2024-04-17T02:22:23.962374+0000","last_clean":"2024-04-17T02:22:23.962374+0000","last_became_active":"2024-04-17T02:22:21.262318+0000","last_became_peered":"2024-04-17T02:22:21.262318+0000","last_unstale":"2024-04-17T02:22:23.962374+0000","last_undegraded":"2024-04-17T02:22:23.962374+0000","last_fullsized":"2024-04-17T02:22:23.962374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:06:57.393992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247996+0000","last_change":"2024-04-17T02:22:22.269974+0000","last_active":"2024-04-17T02:22:23.247996+0000","last_peered":"2024-04-17T02:22:23.247996+0000","last_clean":"2024-04-17T02:22:23.247996+0000","last_became_active":"2024-04-17T02:22:22.269670+0000","last_became_peered":"2024-04-17T02:22:22.269670+0000","last_unstale":"2024-04-17T02:22:23.247996+0000","last_undegraded":"2024-04-17T02:22:23.247996+0000","last_fullsized":"2024-04-17T02:22:23.247996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:40:01.962151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245667+0000","last_change":"2024-04-17T02:22:21.264230+0000","last_active":"2024-04-17T02:22:23.245667+0000","last_peered":"2024-04-17T02:22:23.245667+0000","last_clean":"2024-04-17T02:22:23.245667+0000","last_became_active":"2024-04-17T02:22:21.263922+0000","last_became_peered":"2024-04-17T02:22:21.263922+0000","last_unstale":"2024-04-17T02:22:23.245667+0000","last_undegraded":"2024-04-17T02:22:23.245667+0000","last_fullsized":"2024-04-17T02:22:23.245667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:42:08.530787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246821+0000","last_change":"2024-04-17T02:22:22.272294+0000","last_active":"2024-04-17T02:22:23.246821+0000","last_peered":"2024-04-17T02:22:23.246821+0000","last_clean":"2024-04-17T02:22:23.246821+0000","last_became_active":"2024-04-17T02:22:22.272022+0000","last_became_peered":"2024-04-17T02:22:22.272022+0000","last_unstale":"2024-04-17T02:22:23.246821+0000","last_undegraded":"2024-04-17T02:22:23.246821+0000","last_fullsized":"2024-04-17T02:22:23.246821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:04:01.559523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248286+0000","last_change":"2024-04-17T02:22:21.260781+0000","last_active":"2024-04-17T02:22:23.248286+0000","last_peered":"2024-04-17T02:22:23.248286+0000","last_clean":"2024-04-17T02:22:23.248286+0000","last_became_active":"2024-04-17T02:22:21.260216+0000","last_became_peered":"2024-04-17T02:22:21.260216+0000","last_unstale":"2024-04-17T02:22:23.248286+0000","last_undegraded":"2024-04-17T02:22:23.248286+0000","last_fullsized":"2024-04-17T02:22:23.248286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:25:57.151354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246613+0000","last_change":"2024-04-17T02:22:22.260715+0000","last_active":"2024-04-17T02:22:23.246613+0000","last_peered":"2024-04-17T02:22:23.246613+0000","last_clean":"2024-04-17T02:22:23.246613+0000","last_became_active":"2024-04-17T02:22:22.260292+0000","last_became_peered":"2024-04-17T02:22:22.260292+0000","last_unstale":"2024-04-17T02:22:23.246613+0000","last_undegraded":"2024-04-17T02:22:23.246613+0000","last_fullsized":"2024-04-17T02:22:23.246613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:04:56.666711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963098+0000","last_change":"2024-04-17T02:22:21.263024+0000","last_active":"2024-04-17T02:22:23.963098+0000","last_peered":"2024-04-17T02:22:23.963098+0000","last_clean":"2024-04-17T02:22:23.963098+0000","last_became_active":"2024-04-17T02:22:21.262335+0000","last_became_peered":"2024-04-17T02:22:21.262335+0000","last_unstale":"2024-04-17T02:22:23.963098+0000","last_undegraded":"2024-04-17T02:22:23.963098+0000","last_fullsized":"2024-04-17T02:22:23.963098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:21:11.268956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245289+0000","last_change":"2024-04-17T02:22:22.251488+0000","last_active":"2024-04-17T02:22:23.245289+0000","last_peered":"2024-04-17T02:22:23.245289+0000","last_clean":"2024-04-17T02:22:23.245289+0000","last_became_active":"2024-04-17T02:22:22.251111+0000","last_became_peered":"2024-04-17T02:22:22.251111+0000","last_unstale":"2024-04-17T02:22:23.245289+0000","last_undegraded":"2024-04-17T02:22:23.245289+0000","last_fullsized":"2024-04-17T02:22:23.245289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:43:59.776760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245935+0000","last_change":"2024-04-17T02:22:21.257583+0000","last_active":"2024-04-17T02:22:23.245935+0000","last_peered":"2024-04-17T02:22:23.245935+0000","last_clean":"2024-04-17T02:22:23.245935+0000","last_became_active":"2024-04-17T02:22:21.257330+0000","last_became_peered":"2024-04-17T02:22:21.257330+0000","last_unstale":"2024-04-17T02:22:23.245935+0000","last_undegraded":"2024-04-17T02:22:23.245935+0000","last_fullsized":"2024-04-17T02:22:23.245935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:26:37.106505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248640+0000","last_change":"2024-04-17T02:22:22.264602+0000","last_active":"2024-04-17T02:22:23.248640+0000","last_peered":"2024-04-17T02:22:23.248640+0000","last_clean":"2024-04-17T02:22:23.248640+0000","last_became_active":"2024-04-17T02:22:22.264319+0000","last_became_peered":"2024-04-17T02:22:22.264319+0000","last_unstale":"2024-04-17T02:22:23.248640+0000","last_undegraded":"2024-04-17T02:22:23.248640+0000","last_fullsized":"2024-04-17T02:22:23.248640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:45:35.746928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248295+0000","last_change":"2024-04-17T02:22:21.259254+0000","last_active":"2024-04-17T02:22:23.248295+0000","last_peered":"2024-04-17T02:22:23.248295+0000","last_clean":"2024-04-17T02:22:23.248295+0000","last_became_active":"2024-04-17T02:22:21.258944+0000","last_became_peered":"2024-04-17T02:22:21.258944+0000","last_unstale":"2024-04-17T02:22:23.248295+0000","last_undegraded":"2024-04-17T02:22:23.248295+0000","last_fullsized":"2024-04-17T02:22:23.248295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:21:11.268956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245623+0000","last_change":"2024-04-17T02:22:22.276249+0000","last_active":"2024-04-17T02:22:23.245623+0000","last_peered":"2024-04-17T02:22:23.245623+0000","last_clean":"2024-04-17T02:22:23.245623+0000","last_became_active":"2024-04-17T02:22:22.275817+0000","last_became_peered":"2024-04-17T02:22:22.275817+0000","last_unstale":"2024-04-17T02:22:23.245623+0000","last_undegraded":"2024-04-17T02:22:23.245623+0000","last_fullsized":"2024-04-17T02:22:23.245623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:44:37.302631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963340+0000","last_change":"2024-04-17T02:22:21.260966+0000","last_active":"2024-04-17T02:22:23.963340+0000","last_peered":"2024-04-17T02:22:23.963340+0000","last_clean":"2024-04-17T02:22:23.963340+0000","last_became_active":"2024-04-17T02:22:21.260540+0000","last_became_peered":"2024-04-17T02:22:21.260540+0000","last_unstale":"2024-04-17T02:22:23.963340+0000","last_undegraded":"2024-04-17T02:22:23.963340+0000","last_fullsized":"2024-04-17T02:22:23.963340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:18:47.494578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65024,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":63778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":656236,"data_compressed":32512,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":654556,"data_compressed":32512,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":208896,"data_stored":65322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32512,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32512,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T02:22:28.237 INFO:tasks.ceph.mds.a.smithi017.stderr:2024-04-17T02:22:28.236+0000 7fb8623af640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-17T02:22:29.712 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T02:22:29.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.828+0000 7fcc29619640 1 Processor -- start 2024-04-17T02:22:29.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.828+0000 7fcc29619640 1 -- start start 2024-04-17T02:22:29.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.829+0000 7fcc29619640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcc240bb460 0x7fcc24142580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:29.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.829+0000 7fcc29619640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fcc24142ac0 0x7fcc2414fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:29.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.829+0000 7fcc29619640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc240acea0 con 0x7fcc240ab5b0 2024-04-17T02:22:29.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.829+0000 7fcc29619640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fcc240ab990 con 0x7fcc24142ac0 2024-04-17T02:22:29.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.829+0000 7fcc29619640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fcc2406c330 con 0x7fcc240bb460 2024-04-17T02:22:29.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.829+0000 7fcc227fc640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcc240bb460 0x7fcc24142580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:29.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.829+0000 7fcc227fc640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcc240bb460 0x7fcc24142580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:58100/0 (socket says 172.21.15.17:58100) 2024-04-17T02:22:29.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.829+0000 7fcc227fc640 1 -- 172.21.15.17:0/415617830 learned_addr learned my addr 172.21.15.17:0/415617830 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:29.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.829+0000 7fcc237fe640 1 --2- 172.21.15.17:0/415617830 >> v2:172.21.15.122:3300/0 conn(0x7fcc24142ac0 0x7fcc2414fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:29.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.829+0000 7fcc227fc640 1 -- 172.21.15.17:0/415617830 >> v2:172.21.15.122:3300/0 conn(0x7fcc24142ac0 msgr2=0x7fcc2414fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:29.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.829+0000 7fcc227fc640 1 --2- 172.21.15.17:0/415617830 >> v2:172.21.15.122:3300/0 conn(0x7fcc24142ac0 0x7fcc2414fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:29.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.829+0000 7fcc227fc640 1 -- 172.21.15.17:0/415617830 >> v1:172.21.15.122:6789/0 conn(0x7fcc240ab5b0 legacy=0x7fcc240ac680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:29.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.829+0000 7fcc227fc640 1 -- 172.21.15.17:0/415617830 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc2406dd30 con 0x7fcc240bb460 2024-04-17T02:22:29.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.830+0000 7fcc227fc640 1 --2- 172.21.15.17:0/415617830 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcc240bb460 0x7fcc24142580 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcc18009870 tx=0x7fcc1802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=600b2adafa29dd6b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:29.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.830+0000 7fcc21ffb640 1 -- 172.21.15.17:0/415617830 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc18035020 con 0x7fcc240bb460 2024-04-17T02:22:29.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.830+0000 7fcc21ffb640 1 -- 172.21.15.17:0/415617830 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc18031640 con 0x7fcc240bb460 2024-04-17T02:22:29.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.830+0000 7fcc21ffb640 1 -- 172.21.15.17:0/415617830 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1802d040 con 0x7fcc240bb460 2024-04-17T02:22:29.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.831+0000 7fcc29619640 1 -- 172.21.15.17:0/415617830 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcc240bb460 msgr2=0x7fcc24142580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:29.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.831+0000 7fcc29619640 1 --2- 172.21.15.17:0/415617830 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcc240bb460 0x7fcc24142580 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcc18009870 tx=0x7fcc1802b8f0 comp rx=0 tx=0).stop 2024-04-17T02:22:29.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.831+0000 7fcc29619640 1 -- 172.21.15.17:0/415617830 shutdown_connections 2024-04-17T02:22:29.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.831+0000 7fcc29619640 1 --2- 172.21.15.17:0/415617830 >> v2:172.21.15.122:3300/0 conn(0x7fcc24142ac0 0x7fcc2414fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:29.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.831+0000 7fcc29619640 1 --2- 172.21.15.17:0/415617830 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcc240bb460 0x7fcc24142580 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:29.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.831+0000 7fcc29619640 1 -- 172.21.15.17:0/415617830 >> 172.21.15.17:0/415617830 conn(0x7fcc240ba940 msgr2=0x7fcc240bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:29.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.831+0000 7fcc29619640 1 -- 172.21.15.17:0/415617830 shutdown_connections 2024-04-17T02:22:29.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.831+0000 7fcc29619640 1 -- 172.21.15.17:0/415617830 wait complete. 2024-04-17T02:22:29.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.832+0000 7fcc29619640 1 Processor -- start 2024-04-17T02:22:29.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.832+0000 7fcc29619640 1 -- start start 2024-04-17T02:22:29.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.833+0000 7fcc29619640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc240ab5b0 0x7fcc24146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:29.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.833+0000 7fcc29619640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcc240bb460 0x7fcc241457c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:29.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.833+0000 7fcc29619640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc24142ac0 0x7fcc2413a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:29.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.833+0000 7fcc29619640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcc240a9880 con 0x7fcc24142ac0 2024-04-17T02:22:29.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.833+0000 7fcc29619640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcc240a9700 con 0x7fcc240ab5b0 2024-04-17T02:22:29.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.833+0000 7fcc29619640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fcc2414ffd0 con 0x7fcc240bb460 2024-04-17T02:22:29.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.833+0000 7fcc227fc640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcc240bb460 0x7fcc241457c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:29.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.833+0000 7fcc227fc640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcc240bb460 0x7fcc241457c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:58112/0 (socket says 172.21.15.17:58112) 2024-04-17T02:22:29.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.833+0000 7fcc227fc640 1 -- 172.21.15.17:0/3369668003 learned_addr learned my addr 172.21.15.17:0/3369668003 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:29.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.833+0000 7fcc237fe640 1 --2- 172.21.15.17:0/3369668003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc24142ac0 0x7fcc2413a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:29.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.833+0000 7fcc22ffd640 1 --2- 172.21.15.17:0/3369668003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc240ab5b0 0x7fcc24146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:29.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.833+0000 7fcc227fc640 1 -- 172.21.15.17:0/3369668003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc240ab5b0 msgr2=0x7fcc24146fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:29.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.833+0000 7fcc227fc640 1 --2- 172.21.15.17:0/3369668003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc240ab5b0 0x7fcc24146fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:29.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.833+0000 7fcc227fc640 1 -- 172.21.15.17:0/3369668003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc24142ac0 msgr2=0x7fcc2413a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:29.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.833+0000 7fcc227fc640 1 --2- 172.21.15.17:0/3369668003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc24142ac0 0x7fcc2413a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:29.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.833+0000 7fcc227fc640 1 -- 172.21.15.17:0/3369668003 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc24148960 con 0x7fcc240bb460 2024-04-17T02:22:29.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.833+0000 7fcc237fe640 1 --2- 172.21.15.17:0/3369668003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc24142ac0 0x7fcc2413a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:29.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.833+0000 7fcc22ffd640 1 --2- 172.21.15.17:0/3369668003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc240ab5b0 0x7fcc24146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T02:22:29.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.833+0000 7fcc227fc640 1 --2- 172.21.15.17:0/3369668003 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcc240bb460 0x7fcc241457c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcc180097c0 tx=0x7fcc180046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:29.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.834+0000 7fcc0b7fe640 1 -- 172.21.15.17:0/3369668003 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc18040070 con 0x7fcc240bb460 2024-04-17T02:22:29.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.834+0000 7fcc0b7fe640 1 -- 172.21.15.17:0/3369668003 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc180399f0 con 0x7fcc240bb460 2024-04-17T02:22:29.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.834+0000 7fcc29619640 1 -- 172.21.15.17:0/3369668003 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc24148c20 con 0x7fcc240bb460 2024-04-17T02:22:29.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.834+0000 7fcc0b7fe640 1 -- 172.21.15.17:0/3369668003 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc18035040 con 0x7fcc240bb460 2024-04-17T02:22:29.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.834+0000 7fcc29619640 1 -- 172.21.15.17:0/3369668003 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc241475b0 con 0x7fcc240bb460 2024-04-17T02:22:29.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.835+0000 7fcc29619640 1 -- 172.21.15.17:0/3369668003 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc240687f0 con 0x7fcc240bb460 2024-04-17T02:22:29.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.836+0000 7fcc0b7fe640 1 -- 172.21.15.17:0/3369668003 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7fcc1804b060 con 0x7fcc240bb460 2024-04-17T02:22:29.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.836+0000 7fcc0b7fe640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:29.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.836+0000 7fcc0b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:29.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.836+0000 7fcc0b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:29.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.836+0000 7fcc0b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:29.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.837+0000 7fcc0b7fe640 1 --2- 172.21.15.17:0/3369668003 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fcc1009f480 0x7fcc100a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:29.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.837+0000 7fcc22ffd640 1 --2- 172.21.15.17:0/3369668003 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fcc1009f480 0x7fcc100a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:29.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.837+0000 7fcc0b7fe640 1 -- 172.21.15.17:0/3369668003 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7fcc180eb660 con 0x7fcc240bb460 2024-04-17T02:22:29.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.837+0000 7fcc22ffd640 1 --2- 172.21.15.17:0/3369668003 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fcc1009f480 0x7fcc100a1940 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcc140045b0 tx=0x7fcc14009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:29.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:29.840+0000 7fcc0b7fe640 1 -- 172.21.15.17:0/3369668003 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fcc180ba620 con 0x7fcc240bb460 2024-04-17T02:22:30.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.021+0000 7fcc29619640 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2024-04-17T02:22:30.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.021+0000 7fcc29619640 1 -- 172.21.15.17:0/3369668003 --> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcc240a4d90 con 0x7fcc1009f480 2024-04-17T02:22:30.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.027+0000 7fcc0b7fe640 1 -- 172.21.15.17:0/3369668003 <== mgr.4103 v2:172.21.15.17:6808/563692809 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+268678 (secure 0 0 0) 0x7fcc1405a9a0 con 0x7fcc1009f480 2024-04-17T02:22:30.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.027+0000 7fcc0b7fe640 20 mgrc handle_command_reply tid 0 r 0 2024-04-17T02:22:30.031 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:22:30.033 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-04-17T02:22:30.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.031+0000 7fcc29619640 10 mgrc shutdown 2024-04-17T02:22:30.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.031+0000 7fcc29619640 1 -- 172.21.15.17:0/3369668003 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fcc1009f480 msgr2=0x7fcc100a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:30.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.031+0000 7fcc29619640 1 --2- 172.21.15.17:0/3369668003 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fcc1009f480 0x7fcc100a1940 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcc140045b0 tx=0x7fcc14009040 comp rx=0 tx=0).stop 2024-04-17T02:22:30.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.031+0000 7fcc29619640 1 -- 172.21.15.17:0/3369668003 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcc240bb460 msgr2=0x7fcc241457c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:30.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.031+0000 7fcc29619640 1 --2- 172.21.15.17:0/3369668003 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcc240bb460 0x7fcc241457c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcc180097c0 tx=0x7fcc180046c0 comp rx=0 tx=0).stop 2024-04-17T02:22:30.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.031+0000 7fcc29619640 1 -- 172.21.15.17:0/3369668003 shutdown_connections 2024-04-17T02:22:30.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.031+0000 7fcc29619640 1 --2- 172.21.15.17:0/3369668003 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fcc1009f480 0x7fcc100a1940 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:30.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.031+0000 7fcc29619640 1 --2- 172.21.15.17:0/3369668003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc24142ac0 0x7fcc2413a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:30.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.031+0000 7fcc29619640 1 --2- 172.21.15.17:0/3369668003 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcc240bb460 0x7fcc241457c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:30.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.031+0000 7fcc29619640 1 --2- 172.21.15.17:0/3369668003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc240ab5b0 0x7fcc24146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:30.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.031+0000 7fcc29619640 1 -- 172.21.15.17:0/3369668003 >> 172.21.15.17:0/3369668003 conn(0x7fcc240ba940 msgr2=0x7fcc2413f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:30.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.031+0000 7fcc29619640 1 -- 172.21.15.17:0/3369668003 shutdown_connections 2024-04-17T02:22:30.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.031+0000 7fcc29619640 1 -- 172.21.15.17:0/3369668003 wait complete. 2024-04-17T02:22:30.043 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-04-17T02:22:28.505482+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":124,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":113176,"kb_used_data":912,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377374184,"statfs":{"total":386547056640,"available":386431164416,"internally_reserved":0,"allocated":933888,"data_stored":1439892,"data_compressed":65024,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":6377,"internal_metadata":114878231},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.264955"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247513+0000","last_change":"2024-04-17T02:22:22.259104+0000","last_active":"2024-04-17T02:22:23.247513+0000","last_peered":"2024-04-17T02:22:23.247513+0000","last_clean":"2024-04-17T02:22:23.247513+0000","last_became_active":"2024-04-17T02:22:22.258830+0000","last_became_peered":"2024-04-17T02:22:22.258830+0000","last_unstale":"2024-04-17T02:22:23.247513+0000","last_undegraded":"2024-04-17T02:22:23.247513+0000","last_fullsized":"2024-04-17T02:22:23.247513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:42:09.532783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245851+0000","last_change":"2024-04-17T02:22:22.274708+0000","last_active":"2024-04-17T02:22:23.245851+0000","last_peered":"2024-04-17T02:22:23.245851+0000","last_clean":"2024-04-17T02:22:23.245851+0000","last_became_active":"2024-04-17T02:22:22.274397+0000","last_became_peered":"2024-04-17T02:22:22.274397+0000","last_unstale":"2024-04-17T02:22:23.245851+0000","last_undegraded":"2024-04-17T02:22:23.245851+0000","last_fullsized":"2024-04-17T02:22:23.245851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:04:31.488847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245739+0000","last_change":"2024-04-17T02:22:22.257081+0000","last_active":"2024-04-17T02:22:23.245739+0000","last_peered":"2024-04-17T02:22:23.245739+0000","last_clean":"2024-04-17T02:22:23.245739+0000","last_became_active":"2024-04-17T02:22:22.256695+0000","last_became_peered":"2024-04-17T02:22:22.256695+0000","last_unstale":"2024-04-17T02:22:23.245739+0000","last_undegraded":"2024-04-17T02:22:23.245739+0000","last_fullsized":"2024-04-17T02:22:23.245739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:52:02.173760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962692+0000","last_change":"2024-04-17T02:22:22.272106+0000","last_active":"2024-04-17T02:22:23.962692+0000","last_peered":"2024-04-17T02:22:23.962692+0000","last_clean":"2024-04-17T02:22:23.962692+0000","last_became_active":"2024-04-17T02:22:22.271074+0000","last_became_peered":"2024-04-17T02:22:22.271074+0000","last_unstale":"2024-04-17T02:22:23.962692+0000","last_undegraded":"2024-04-17T02:22:23.962692+0000","last_fullsized":"2024-04-17T02:22:23.962692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:45:41.860323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248355+0000","last_change":"2024-04-17T02:22:22.258839+0000","last_active":"2024-04-17T02:22:23.248355+0000","last_peered":"2024-04-17T02:22:23.248355+0000","last_clean":"2024-04-17T02:22:23.248355+0000","last_became_active":"2024-04-17T02:22:22.257715+0000","last_became_peered":"2024-04-17T02:22:22.257715+0000","last_unstale":"2024-04-17T02:22:23.248355+0000","last_undegraded":"2024-04-17T02:22:23.248355+0000","last_fullsized":"2024-04-17T02:22:23.248355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:26:13.695328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247496+0000","last_change":"2024-04-17T02:22:22.259395+0000","last_active":"2024-04-17T02:22:23.247496+0000","last_peered":"2024-04-17T02:22:23.247496+0000","last_clean":"2024-04-17T02:22:23.247496+0000","last_became_active":"2024-04-17T02:22:22.258508+0000","last_became_peered":"2024-04-17T02:22:22.258508+0000","last_unstale":"2024-04-17T02:22:23.247496+0000","last_undegraded":"2024-04-17T02:22:23.247496+0000","last_fullsized":"2024-04-17T02:22:23.247496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:34:29.435312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248096+0000","last_change":"2024-04-17T02:22:22.261760+0000","last_active":"2024-04-17T02:22:23.248096+0000","last_peered":"2024-04-17T02:22:23.248096+0000","last_clean":"2024-04-17T02:22:23.248096+0000","last_became_active":"2024-04-17T02:22:22.261501+0000","last_became_peered":"2024-04-17T02:22:22.261501+0000","last_unstale":"2024-04-17T02:22:23.248096+0000","last_undegraded":"2024-04-17T02:22:23.248096+0000","last_fullsized":"2024-04-17T02:22:23.248096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:07:20.363260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.244553+0000","last_change":"2024-04-17T02:22:22.257716+0000","last_active":"2024-04-17T02:22:23.244553+0000","last_peered":"2024-04-17T02:22:23.244553+0000","last_clean":"2024-04-17T02:22:23.244553+0000","last_became_active":"2024-04-17T02:22:22.257354+0000","last_became_peered":"2024-04-17T02:22:22.257354+0000","last_unstale":"2024-04-17T02:22:23.244553+0000","last_undegraded":"2024-04-17T02:22:23.244553+0000","last_fullsized":"2024-04-17T02:22:23.244553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:45:35.746928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247533+0000","last_change":"2024-04-17T02:22:22.261339+0000","last_active":"2024-04-17T02:22:23.247533+0000","last_peered":"2024-04-17T02:22:23.247533+0000","last_clean":"2024-04-17T02:22:23.247533+0000","last_became_active":"2024-04-17T02:22:22.258124+0000","last_became_peered":"2024-04-17T02:22:22.258124+0000","last_unstale":"2024-04-17T02:22:23.247533+0000","last_undegraded":"2024-04-17T02:22:23.247533+0000","last_fullsized":"2024-04-17T02:22:23.247533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:31:34.863748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962968+0000","last_change":"2024-04-17T02:22:22.276919+0000","last_active":"2024-04-17T02:22:23.962968+0000","last_peered":"2024-04-17T02:22:23.962968+0000","last_clean":"2024-04-17T02:22:23.962968+0000","last_became_active":"2024-04-17T02:22:22.273911+0000","last_became_peered":"2024-04-17T02:22:22.273911+0000","last_unstale":"2024-04-17T02:22:23.962968+0000","last_undegraded":"2024-04-17T02:22:23.962968+0000","last_fullsized":"2024-04-17T02:22:23.962968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:33:01.850142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962960+0000","last_change":"2024-04-17T02:22:22.269997+0000","last_active":"2024-04-17T02:22:23.962960+0000","last_peered":"2024-04-17T02:22:23.962960+0000","last_clean":"2024-04-17T02:22:23.962960+0000","last_became_active":"2024-04-17T02:22:22.269071+0000","last_became_peered":"2024-04-17T02:22:22.269071+0000","last_unstale":"2024-04-17T02:22:23.962960+0000","last_undegraded":"2024-04-17T02:22:23.962960+0000","last_fullsized":"2024-04-17T02:22:23.962960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:28:17.292009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246781+0000","last_change":"2024-04-17T02:22:22.255449+0000","last_active":"2024-04-17T02:22:23.246781+0000","last_peered":"2024-04-17T02:22:23.246781+0000","last_clean":"2024-04-17T02:22:23.246781+0000","last_became_active":"2024-04-17T02:22:22.254619+0000","last_became_peered":"2024-04-17T02:22:22.254619+0000","last_unstale":"2024-04-17T02:22:23.246781+0000","last_undegraded":"2024-04-17T02:22:23.246781+0000","last_fullsized":"2024-04-17T02:22:23.246781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:29:09.389819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246450+0000","last_change":"2024-04-17T02:22:22.257767+0000","last_active":"2024-04-17T02:22:23.246450+0000","last_peered":"2024-04-17T02:22:23.246450+0000","last_clean":"2024-04-17T02:22:23.246450+0000","last_became_active":"2024-04-17T02:22:22.257506+0000","last_became_peered":"2024-04-17T02:22:22.257506+0000","last_unstale":"2024-04-17T02:22:23.246450+0000","last_undegraded":"2024-04-17T02:22:23.246450+0000","last_fullsized":"2024-04-17T02:22:23.246450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:36:11.795618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245156+0000","last_change":"2024-04-17T02:22:22.254083+0000","last_active":"2024-04-17T02:22:23.245156+0000","last_peered":"2024-04-17T02:22:23.245156+0000","last_clean":"2024-04-17T02:22:23.245156+0000","last_became_active":"2024-04-17T02:22:22.253756+0000","last_became_peered":"2024-04-17T02:22:22.253756+0000","last_unstale":"2024-04-17T02:22:23.245156+0000","last_undegraded":"2024-04-17T02:22:23.245156+0000","last_fullsized":"2024-04-17T02:22:23.245156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:55:12.334737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.244837+0000","last_change":"2024-04-17T02:22:22.269407+0000","last_active":"2024-04-17T02:22:23.244837+0000","last_peered":"2024-04-17T02:22:23.244837+0000","last_clean":"2024-04-17T02:22:23.244837+0000","last_became_active":"2024-04-17T02:22:22.269130+0000","last_became_peered":"2024-04-17T02:22:22.269130+0000","last_unstale":"2024-04-17T02:22:23.244837+0000","last_undegraded":"2024-04-17T02:22:23.244837+0000","last_fullsized":"2024-04-17T02:22:23.244837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:44:17.761493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.244638+0000","last_change":"2024-04-17T02:22:22.257257+0000","last_active":"2024-04-17T02:22:23.244638+0000","last_peered":"2024-04-17T02:22:23.244638+0000","last_clean":"2024-04-17T02:22:23.244638+0000","last_became_active":"2024-04-17T02:22:22.256498+0000","last_became_peered":"2024-04-17T02:22:22.256498+0000","last_unstale":"2024-04-17T02:22:23.244638+0000","last_undegraded":"2024-04-17T02:22:23.244638+0000","last_fullsized":"2024-04-17T02:22:23.244638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:09:57.616528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963373+0000","last_change":"2024-04-17T02:22:22.273771+0000","last_active":"2024-04-17T02:22:23.963373+0000","last_peered":"2024-04-17T02:22:23.963373+0000","last_clean":"2024-04-17T02:22:23.963373+0000","last_became_active":"2024-04-17T02:22:22.273403+0000","last_became_peered":"2024-04-17T02:22:22.273403+0000","last_unstale":"2024-04-17T02:22:23.963373+0000","last_undegraded":"2024-04-17T02:22:23.963373+0000","last_fullsized":"2024-04-17T02:22:23.963373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:43:59.776760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248116+0000","last_change":"2024-04-17T02:22:22.258817+0000","last_active":"2024-04-17T02:22:23.248116+0000","last_peered":"2024-04-17T02:22:23.248116+0000","last_clean":"2024-04-17T02:22:23.248116+0000","last_became_active":"2024-04-17T02:22:22.258461+0000","last_became_peered":"2024-04-17T02:22:22.258461+0000","last_unstale":"2024-04-17T02:22:23.248116+0000","last_undegraded":"2024-04-17T02:22:23.248116+0000","last_fullsized":"2024-04-17T02:22:23.248116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:24:39.123134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246891+0000","last_change":"2024-04-17T02:22:22.260864+0000","last_active":"2024-04-17T02:22:23.246891+0000","last_peered":"2024-04-17T02:22:23.246891+0000","last_clean":"2024-04-17T02:22:23.246891+0000","last_became_active":"2024-04-17T02:22:22.260605+0000","last_became_peered":"2024-04-17T02:22:22.260605+0000","last_unstale":"2024-04-17T02:22:23.246891+0000","last_undegraded":"2024-04-17T02:22:23.246891+0000","last_fullsized":"2024-04-17T02:22:23.246891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:24:43.421842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962806+0000","last_change":"2024-04-17T02:22:22.271849+0000","last_active":"2024-04-17T02:22:23.962806+0000","last_peered":"2024-04-17T02:22:23.962806+0000","last_clean":"2024-04-17T02:22:23.962806+0000","last_became_active":"2024-04-17T02:22:22.270030+0000","last_became_peered":"2024-04-17T02:22:22.270030+0000","last_unstale":"2024-04-17T02:22:23.962806+0000","last_undegraded":"2024-04-17T02:22:23.962806+0000","last_fullsized":"2024-04-17T02:22:23.962806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:26:13.695328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245164+0000","last_change":"2024-04-17T02:22:22.255249+0000","last_active":"2024-04-17T02:22:23.245164+0000","last_peered":"2024-04-17T02:22:23.245164+0000","last_clean":"2024-04-17T02:22:23.245164+0000","last_became_active":"2024-04-17T02:22:22.254964+0000","last_became_peered":"2024-04-17T02:22:22.254964+0000","last_unstale":"2024-04-17T02:22:23.245164+0000","last_undegraded":"2024-04-17T02:22:23.245164+0000","last_fullsized":"2024-04-17T02:22:23.245164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:08:08.804961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962272+0000","last_change":"2024-04-17T02:22:22.277803+0000","last_active":"2024-04-17T02:22:23.962272+0000","last_peered":"2024-04-17T02:22:23.962272+0000","last_clean":"2024-04-17T02:22:23.962272+0000","last_became_active":"2024-04-17T02:22:22.277509+0000","last_became_peered":"2024-04-17T02:22:22.277509+0000","last_unstale":"2024-04-17T02:22:23.962272+0000","last_undegraded":"2024-04-17T02:22:23.962272+0000","last_fullsized":"2024-04-17T02:22:23.962272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:40:01.962151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248329+0000","last_change":"2024-04-17T02:22:22.274201+0000","last_active":"2024-04-17T02:22:23.248329+0000","last_peered":"2024-04-17T02:22:23.248329+0000","last_clean":"2024-04-17T02:22:23.248329+0000","last_became_active":"2024-04-17T02:22:22.273832+0000","last_became_peered":"2024-04-17T02:22:22.273832+0000","last_unstale":"2024-04-17T02:22:23.248329+0000","last_undegraded":"2024-04-17T02:22:23.248329+0000","last_fullsized":"2024-04-17T02:22:23.248329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:45:41.860323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.244683+0000","last_change":"2024-04-17T02:22:22.250494+0000","last_active":"2024-04-17T02:22:23.244683+0000","last_peered":"2024-04-17T02:22:23.244683+0000","last_clean":"2024-04-17T02:22:23.244683+0000","last_became_active":"2024-04-17T02:22:22.250080+0000","last_became_peered":"2024-04-17T02:22:22.250080+0000","last_unstale":"2024-04-17T02:22:23.244683+0000","last_undegraded":"2024-04-17T02:22:23.244683+0000","last_fullsized":"2024-04-17T02:22:23.244683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:35:24.036979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963005+0000","last_change":"2024-04-17T02:22:22.274842+0000","last_active":"2024-04-17T02:22:23.963005+0000","last_peered":"2024-04-17T02:22:23.963005+0000","last_clean":"2024-04-17T02:22:23.963005+0000","last_became_active":"2024-04-17T02:22:22.273726+0000","last_became_peered":"2024-04-17T02:22:22.273726+0000","last_unstale":"2024-04-17T02:22:23.963005+0000","last_undegraded":"2024-04-17T02:22:23.963005+0000","last_fullsized":"2024-04-17T02:22:23.963005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:45:35.746928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963211+0000","last_change":"2024-04-17T02:22:22.273623+0000","last_active":"2024-04-17T02:22:23.963211+0000","last_peered":"2024-04-17T02:22:23.963211+0000","last_clean":"2024-04-17T02:22:23.963211+0000","last_became_active":"2024-04-17T02:22:22.273324+0000","last_became_peered":"2024-04-17T02:22:22.273324+0000","last_unstale":"2024-04-17T02:22:23.963211+0000","last_undegraded":"2024-04-17T02:22:23.963211+0000","last_fullsized":"2024-04-17T02:22:23.963211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:55:12.334737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246237+0000","last_change":"2024-04-17T02:22:22.259990+0000","last_active":"2024-04-17T02:22:23.246237+0000","last_peered":"2024-04-17T02:22:23.246237+0000","last_clean":"2024-04-17T02:22:23.246237+0000","last_became_active":"2024-04-17T02:22:22.259635+0000","last_became_peered":"2024-04-17T02:22:22.259635+0000","last_unstale":"2024-04-17T02:22:23.246237+0000","last_undegraded":"2024-04-17T02:22:23.246237+0000","last_fullsized":"2024-04-17T02:22:23.246237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:38:51.312268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963321+0000","last_change":"2024-04-17T02:22:22.269783+0000","last_active":"2024-04-17T02:22:23.963321+0000","last_peered":"2024-04-17T02:22:23.963321+0000","last_clean":"2024-04-17T02:22:23.963321+0000","last_became_active":"2024-04-17T02:22:22.269006+0000","last_became_peered":"2024-04-17T02:22:22.269006+0000","last_unstale":"2024-04-17T02:22:23.963321+0000","last_undegraded":"2024-04-17T02:22:23.963321+0000","last_fullsized":"2024-04-17T02:22:23.963321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:08:08.804961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248147+0000","last_change":"2024-04-17T02:22:22.258194+0000","last_active":"2024-04-17T02:22:23.248147+0000","last_peered":"2024-04-17T02:22:23.248147+0000","last_clean":"2024-04-17T02:22:23.248147+0000","last_became_active":"2024-04-17T02:22:22.257344+0000","last_became_peered":"2024-04-17T02:22:22.257344+0000","last_unstale":"2024-04-17T02:22:23.248147+0000","last_undegraded":"2024-04-17T02:22:23.248147+0000","last_fullsized":"2024-04-17T02:22:23.248147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:12:23.134715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962539+0000","last_change":"2024-04-17T02:22:22.276867+0000","last_active":"2024-04-17T02:22:23.962539+0000","last_peered":"2024-04-17T02:22:23.962539+0000","last_clean":"2024-04-17T02:22:23.962539+0000","last_became_active":"2024-04-17T02:22:22.273911+0000","last_became_peered":"2024-04-17T02:22:22.273911+0000","last_unstale":"2024-04-17T02:22:23.962539+0000","last_undegraded":"2024-04-17T02:22:23.962539+0000","last_fullsized":"2024-04-17T02:22:23.962539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:12:23.134715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248369+0000","last_change":"2024-04-17T02:22:22.274573+0000","last_active":"2024-04-17T02:22:23.248369+0000","last_peered":"2024-04-17T02:22:23.248369+0000","last_clean":"2024-04-17T02:22:23.248369+0000","last_became_active":"2024-04-17T02:22:22.274287+0000","last_became_peered":"2024-04-17T02:22:22.274287+0000","last_unstale":"2024-04-17T02:22:23.248369+0000","last_undegraded":"2024-04-17T02:22:23.248369+0000","last_fullsized":"2024-04-17T02:22:23.248369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:02:38.660756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.244774+0000","last_change":"2024-04-17T02:22:22.249744+0000","last_active":"2024-04-17T02:22:23.244774+0000","last_peered":"2024-04-17T02:22:23.244774+0000","last_clean":"2024-04-17T02:22:23.244774+0000","last_became_active":"2024-04-17T02:22:22.249456+0000","last_became_peered":"2024-04-17T02:22:22.249456+0000","last_unstale":"2024-04-17T02:22:23.244774+0000","last_undegraded":"2024-04-17T02:22:23.244774+0000","last_fullsized":"2024-04-17T02:22:23.244774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:58:55.176237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247534+0000","last_change":"2024-04-17T02:22:22.276822+0000","last_active":"2024-04-17T02:22:23.247534+0000","last_peered":"2024-04-17T02:22:23.247534+0000","last_clean":"2024-04-17T02:22:23.247534+0000","last_became_active":"2024-04-17T02:22:22.276565+0000","last_became_peered":"2024-04-17T02:22:22.276565+0000","last_unstale":"2024-04-17T02:22:23.247534+0000","last_undegraded":"2024-04-17T02:22:23.247534+0000","last_fullsized":"2024-04-17T02:22:23.247534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:00:17.976771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248519+0000","last_change":"2024-04-17T02:22:21.260392+0000","last_active":"2024-04-17T02:22:23.248519+0000","last_peered":"2024-04-17T02:22:23.248519+0000","last_clean":"2024-04-17T02:22:23.248519+0000","last_became_active":"2024-04-17T02:22:21.259347+0000","last_became_peered":"2024-04-17T02:22:21.259347+0000","last_unstale":"2024-04-17T02:22:23.248519+0000","last_undegraded":"2024-04-17T02:22:23.248519+0000","last_fullsized":"2024-04-17T02:22:23.248519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:07:12.265185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248186+0000","last_change":"2024-04-17T02:22:22.260150+0000","last_active":"2024-04-17T02:22:23.248186+0000","last_peered":"2024-04-17T02:22:23.248186+0000","last_clean":"2024-04-17T02:22:23.248186+0000","last_became_active":"2024-04-17T02:22:22.259875+0000","last_became_peered":"2024-04-17T02:22:22.259875+0000","last_unstale":"2024-04-17T02:22:23.248186+0000","last_undegraded":"2024-04-17T02:22:23.248186+0000","last_fullsized":"2024-04-17T02:22:23.248186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:59:56.366536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246343+0000","last_change":"2024-04-17T02:22:21.252345+0000","last_active":"2024-04-17T02:22:23.246343+0000","last_peered":"2024-04-17T02:22:23.246343+0000","last_clean":"2024-04-17T02:22:23.246343+0000","last_became_active":"2024-04-17T02:22:21.252035+0000","last_became_peered":"2024-04-17T02:22:21.252035+0000","last_unstale":"2024-04-17T02:22:23.246343+0000","last_undegraded":"2024-04-17T02:22:23.246343+0000","last_fullsized":"2024-04-17T02:22:23.246343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:00:58.747974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248224+0000","last_change":"2024-04-17T02:22:22.277830+0000","last_active":"2024-04-17T02:22:23.248224+0000","last_peered":"2024-04-17T02:22:23.248224+0000","last_clean":"2024-04-17T02:22:23.248224+0000","last_became_active":"2024-04-17T02:22:22.277558+0000","last_became_peered":"2024-04-17T02:22:22.277558+0000","last_unstale":"2024-04-17T02:22:23.248224+0000","last_undegraded":"2024-04-17T02:22:23.248224+0000","last_fullsized":"2024-04-17T02:22:23.248224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:06:11.399207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.244931+0000","last_change":"2024-04-17T02:22:21.257436+0000","last_active":"2024-04-17T02:22:23.244931+0000","last_peered":"2024-04-17T02:22:23.244931+0000","last_clean":"2024-04-17T02:22:23.244931+0000","last_became_active":"2024-04-17T02:22:21.256912+0000","last_became_peered":"2024-04-17T02:22:21.256912+0000","last_unstale":"2024-04-17T02:22:23.244931+0000","last_undegraded":"2024-04-17T02:22:23.244931+0000","last_fullsized":"2024-04-17T02:22:23.244931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:24:42.419846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248533+0000","last_change":"2024-04-17T02:22:22.278083+0000","last_active":"2024-04-17T02:22:23.248533+0000","last_peered":"2024-04-17T02:22:23.248533+0000","last_clean":"2024-04-17T02:22:23.248533+0000","last_became_active":"2024-04-17T02:22:22.277838+0000","last_became_peered":"2024-04-17T02:22:22.277838+0000","last_unstale":"2024-04-17T02:22:23.248533+0000","last_undegraded":"2024-04-17T02:22:23.248533+0000","last_fullsized":"2024-04-17T02:22:23.248533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:28:17.292009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.244776+0000","last_change":"2024-04-17T02:22:21.264203+0000","last_active":"2024-04-17T02:22:23.244776+0000","last_peered":"2024-04-17T02:22:23.244776+0000","last_clean":"2024-04-17T02:22:23.244776+0000","last_became_active":"2024-04-17T02:22:21.263926+0000","last_became_peered":"2024-04-17T02:22:21.263926+0000","last_unstale":"2024-04-17T02:22:23.244776+0000","last_undegraded":"2024-04-17T02:22:23.244776+0000","last_fullsized":"2024-04-17T02:22:23.244776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:12:51.802467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245897+0000","last_change":"2024-04-17T02:22:21.262253+0000","last_active":"2024-04-17T02:22:23.245897+0000","last_peered":"2024-04-17T02:22:23.245897+0000","last_clean":"2024-04-17T02:22:23.245897+0000","last_became_active":"2024-04-17T02:22:21.261336+0000","last_became_peered":"2024-04-17T02:22:21.261336+0000","last_unstale":"2024-04-17T02:22:23.245897+0000","last_undegraded":"2024-04-17T02:22:23.245897+0000","last_fullsized":"2024-04-17T02:22:23.245897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:20:13.640602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247204+0000","last_change":"2024-04-17T02:22:22.259672+0000","last_active":"2024-04-17T02:22:23.247204+0000","last_peered":"2024-04-17T02:22:23.247204+0000","last_clean":"2024-04-17T02:22:23.247204+0000","last_became_active":"2024-04-17T02:22:22.259407+0000","last_became_peered":"2024-04-17T02:22:22.259407+0000","last_unstale":"2024-04-17T02:22:23.247204+0000","last_undegraded":"2024-04-17T02:22:23.247204+0000","last_fullsized":"2024-04-17T02:22:23.247204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:56:41.058446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246089+0000","last_change":"2024-04-17T02:22:21.251579+0000","last_active":"2024-04-17T02:22:23.246089+0000","last_peered":"2024-04-17T02:22:23.246089+0000","last_clean":"2024-04-17T02:22:23.246089+0000","last_became_active":"2024-04-17T02:22:21.251330+0000","last_became_peered":"2024-04-17T02:22:21.251330+0000","last_unstale":"2024-04-17T02:22:23.246089+0000","last_undegraded":"2024-04-17T02:22:23.246089+0000","last_fullsized":"2024-04-17T02:22:23.246089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:30:22.630029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962294+0000","last_change":"2024-04-17T02:22:22.270839+0000","last_active":"2024-04-17T02:22:23.962294+0000","last_peered":"2024-04-17T02:22:23.962294+0000","last_clean":"2024-04-17T02:22:23.962294+0000","last_became_active":"2024-04-17T02:22:22.268977+0000","last_became_peered":"2024-04-17T02:22:22.268977+0000","last_unstale":"2024-04-17T02:22:23.962294+0000","last_undegraded":"2024-04-17T02:22:23.962294+0000","last_fullsized":"2024-04-17T02:22:23.962294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:07:20.363260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246033+0000","last_change":"2024-04-17T02:22:21.256996+0000","last_active":"2024-04-17T02:22:23.246033+0000","last_peered":"2024-04-17T02:22:23.246033+0000","last_clean":"2024-04-17T02:22:23.246033+0000","last_became_active":"2024-04-17T02:22:21.256082+0000","last_became_peered":"2024-04-17T02:22:21.256082+0000","last_unstale":"2024-04-17T02:22:23.246033+0000","last_undegraded":"2024-04-17T02:22:23.246033+0000","last_fullsized":"2024-04-17T02:22:23.246033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:42:14.419225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245472+0000","last_change":"2024-04-17T02:22:22.258273+0000","last_active":"2024-04-17T02:22:23.245472+0000","last_peered":"2024-04-17T02:22:23.245472+0000","last_clean":"2024-04-17T02:22:23.245472+0000","last_became_active":"2024-04-17T02:22:22.257818+0000","last_became_peered":"2024-04-17T02:22:22.257818+0000","last_unstale":"2024-04-17T02:22:23.245472+0000","last_undegraded":"2024-04-17T02:22:23.245472+0000","last_fullsized":"2024-04-17T02:22:23.245472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:45:43.904195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245616+0000","last_change":"2024-04-17T02:22:21.250003+0000","last_active":"2024-04-17T02:22:23.245616+0000","last_peered":"2024-04-17T02:22:23.245616+0000","last_clean":"2024-04-17T02:22:23.245616+0000","last_became_active":"2024-04-17T02:22:21.249709+0000","last_became_peered":"2024-04-17T02:22:21.249709+0000","last_unstale":"2024-04-17T02:22:23.245616+0000","last_undegraded":"2024-04-17T02:22:23.245616+0000","last_fullsized":"2024-04-17T02:22:23.245616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:56:40.377974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246786+0000","last_change":"2024-04-17T02:22:22.255008+0000","last_active":"2024-04-17T02:22:23.246786+0000","last_peered":"2024-04-17T02:22:23.246786+0000","last_clean":"2024-04-17T02:22:23.246786+0000","last_became_active":"2024-04-17T02:22:22.254689+0000","last_became_peered":"2024-04-17T02:22:22.254689+0000","last_unstale":"2024-04-17T02:22:23.246786+0000","last_undegraded":"2024-04-17T02:22:23.246786+0000","last_fullsized":"2024-04-17T02:22:23.246786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:05:18.321177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248616+0000","last_change":"2024-04-17T02:22:21.265269+0000","last_active":"2024-04-17T02:22:23.248616+0000","last_peered":"2024-04-17T02:22:23.248616+0000","last_clean":"2024-04-17T02:22:23.248616+0000","last_became_active":"2024-04-17T02:22:21.264981+0000","last_became_peered":"2024-04-17T02:22:21.264981+0000","last_unstale":"2024-04-17T02:22:23.248616+0000","last_undegraded":"2024-04-17T02:22:23.248616+0000","last_fullsized":"2024-04-17T02:22:23.248616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:27:52.759868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962935+0000","last_change":"2024-04-17T02:22:22.271981+0000","last_active":"2024-04-17T02:22:23.962935+0000","last_peered":"2024-04-17T02:22:23.962935+0000","last_clean":"2024-04-17T02:22:23.962935+0000","last_became_active":"2024-04-17T02:22:22.270317+0000","last_became_peered":"2024-04-17T02:22:22.270317+0000","last_unstale":"2024-04-17T02:22:23.962935+0000","last_undegraded":"2024-04-17T02:22:23.962935+0000","last_fullsized":"2024-04-17T02:22:23.962935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:02:38.660756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245901+0000","last_change":"2024-04-17T02:22:21.262438+0000","last_active":"2024-04-17T02:22:23.245901+0000","last_peered":"2024-04-17T02:22:23.245901+0000","last_clean":"2024-04-17T02:22:23.245901+0000","last_became_active":"2024-04-17T02:22:21.261470+0000","last_became_peered":"2024-04-17T02:22:21.261470+0000","last_unstale":"2024-04-17T02:22:23.245901+0000","last_undegraded":"2024-04-17T02:22:23.245901+0000","last_fullsized":"2024-04-17T02:22:23.245901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:22:02.248276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245775+0000","last_change":"2024-04-17T02:22:22.255994+0000","last_active":"2024-04-17T02:22:23.245775+0000","last_peered":"2024-04-17T02:22:23.245775+0000","last_clean":"2024-04-17T02:22:23.245775+0000","last_became_active":"2024-04-17T02:22:22.255089+0000","last_became_peered":"2024-04-17T02:22:22.255089+0000","last_unstale":"2024-04-17T02:22:23.245775+0000","last_undegraded":"2024-04-17T02:22:23.245775+0000","last_fullsized":"2024-04-17T02:22:23.245775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:50:00.777691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248497+0000","last_change":"2024-04-17T02:22:21.259659+0000","last_active":"2024-04-17T02:22:23.248497+0000","last_peered":"2024-04-17T02:22:23.248497+0000","last_clean":"2024-04-17T02:22:23.248497+0000","last_became_active":"2024-04-17T02:22:21.259030+0000","last_became_peered":"2024-04-17T02:22:21.259030+0000","last_unstale":"2024-04-17T02:22:23.248497+0000","last_undegraded":"2024-04-17T02:22:23.248497+0000","last_fullsized":"2024-04-17T02:22:23.248497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:43:22.970177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247238+0000","last_change":"2024-04-17T02:22:22.254414+0000","last_active":"2024-04-17T02:22:23.247238+0000","last_peered":"2024-04-17T02:22:23.247238+0000","last_clean":"2024-04-17T02:22:23.247238+0000","last_became_active":"2024-04-17T02:22:22.253963+0000","last_became_peered":"2024-04-17T02:22:22.253963+0000","last_unstale":"2024-04-17T02:22:23.247238+0000","last_undegraded":"2024-04-17T02:22:23.247238+0000","last_fullsized":"2024-04-17T02:22:23.247238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:56:41.379971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247417+0000","last_change":"2024-04-17T02:22:21.266419+0000","last_active":"2024-04-17T02:22:23.247417+0000","last_peered":"2024-04-17T02:22:23.247417+0000","last_clean":"2024-04-17T02:22:23.247417+0000","last_became_active":"2024-04-17T02:22:21.266123+0000","last_became_peered":"2024-04-17T02:22:21.266123+0000","last_unstale":"2024-04-17T02:22:23.247417+0000","last_undegraded":"2024-04-17T02:22:23.247417+0000","last_fullsized":"2024-04-17T02:22:23.247417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:06:57.393992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963114+0000","last_change":"2024-04-17T02:22:22.277085+0000","last_active":"2024-04-17T02:22:23.963114+0000","last_peered":"2024-04-17T02:22:23.963114+0000","last_clean":"2024-04-17T02:22:23.963114+0000","last_became_active":"2024-04-17T02:22:22.275396+0000","last_became_peered":"2024-04-17T02:22:22.275396+0000","last_unstale":"2024-04-17T02:22:23.963114+0000","last_undegraded":"2024-04-17T02:22:23.963114+0000","last_fullsized":"2024-04-17T02:22:23.963114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:35:24.036979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":176,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962291+0000","last_change":"2024-04-17T02:22:12.100529+0000","last_active":"2024-04-17T02:22:23.962291+0000","last_peered":"2024-04-17T02:22:23.962291+0000","last_clean":"2024-04-17T02:22:23.962291+0000","last_became_active":"2024-04-17T02:22:12.100191+0000","last_became_peered":"2024-04-17T02:22:12.100191+0000","last_unstale":"2024-04-17T02:22:23.962291+0000","last_undegraded":"2024-04-17T02:22:23.962291+0000","last_fullsized":"2024-04-17T02:22:23.962291+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:11.088733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:11.088733+0000","last_clean_scrub_stamp":"2024-04-17T02:22:11.088733+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:47:32.959035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245357+0000","last_change":"2024-04-17T02:22:17.123965+0000","last_active":"2024-04-17T02:22:23.245357+0000","last_peered":"2024-04-17T02:22:23.245357+0000","last_clean":"2024-04-17T02:22:23.245357+0000","last_became_active":"2024-04-17T02:22:17.123282+0000","last_became_peered":"2024-04-17T02:22:17.123282+0000","last_unstale":"2024-04-17T02:22:23.245357+0000","last_undegraded":"2024-04-17T02:22:23.245357+0000","last_fullsized":"2024-04-17T02:22:23.245357+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:00:54.621590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247944+0000","last_change":"2024-04-17T02:22:21.259046+0000","last_active":"2024-04-17T02:22:23.247944+0000","last_peered":"2024-04-17T02:22:23.247944+0000","last_clean":"2024-04-17T02:22:23.247944+0000","last_became_active":"2024-04-17T02:22:21.258750+0000","last_became_peered":"2024-04-17T02:22:21.258750+0000","last_unstale":"2024-04-17T02:22:23.247944+0000","last_undegraded":"2024-04-17T02:22:23.247944+0000","last_fullsized":"2024-04-17T02:22:23.247944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:21:58.622774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246098+0000","last_change":"2024-04-17T02:22:22.256960+0000","last_active":"2024-04-17T02:22:23.246098+0000","last_peered":"2024-04-17T02:22:23.246098+0000","last_clean":"2024-04-17T02:22:23.246098+0000","last_became_active":"2024-04-17T02:22:22.256613+0000","last_became_peered":"2024-04-17T02:22:22.256613+0000","last_unstale":"2024-04-17T02:22:23.246098+0000","last_undegraded":"2024-04-17T02:22:23.246098+0000","last_fullsized":"2024-04-17T02:22:23.246098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:32:56.166132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.244846+0000","last_change":"2024-04-17T02:22:17.123918+0000","last_active":"2024-04-17T02:22:23.244846+0000","last_peered":"2024-04-17T02:22:23.244846+0000","last_clean":"2024-04-17T02:22:23.244846+0000","last_became_active":"2024-04-17T02:22:17.123423+0000","last_became_peered":"2024-04-17T02:22:17.123423+0000","last_unstale":"2024-04-17T02:22:23.244846+0000","last_undegraded":"2024-04-17T02:22:23.244846+0000","last_fullsized":"2024-04-17T02:22:23.244846+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:25:53.024970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962441+0000","last_change":"2024-04-17T02:22:21.260085+0000","last_active":"2024-04-17T02:22:23.962441+0000","last_peered":"2024-04-17T02:22:23.962441+0000","last_clean":"2024-04-17T02:22:23.962441+0000","last_became_active":"2024-04-17T02:22:21.259738+0000","last_became_peered":"2024-04-17T02:22:21.259738+0000","last_unstale":"2024-04-17T02:22:23.962441+0000","last_undegraded":"2024-04-17T02:22:23.962441+0000","last_fullsized":"2024-04-17T02:22:23.962441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:34:47.001187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247930+0000","last_change":"2024-04-17T02:22:22.276216+0000","last_active":"2024-04-17T02:22:23.247930+0000","last_peered":"2024-04-17T02:22:23.247930+0000","last_clean":"2024-04-17T02:22:23.247930+0000","last_became_active":"2024-04-17T02:22:22.275925+0000","last_became_peered":"2024-04-17T02:22:22.275925+0000","last_unstale":"2024-04-17T02:22:23.247930+0000","last_undegraded":"2024-04-17T02:22:23.247930+0000","last_fullsized":"2024-04-17T02:22:23.247930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:12:02.539603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247214+0000","last_change":"2024-04-17T02:22:17.560526+0000","last_active":"2024-04-17T02:22:23.247214+0000","last_peered":"2024-04-17T02:22:23.247214+0000","last_clean":"2024-04-17T02:22:23.247214+0000","last_became_active":"2024-04-17T02:22:17.560120+0000","last_became_peered":"2024-04-17T02:22:17.560120+0000","last_unstale":"2024-04-17T02:22:23.247214+0000","last_undegraded":"2024-04-17T02:22:23.247214+0000","last_fullsized":"2024-04-17T02:22:23.247214+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:49:30.975553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962096+0000","last_change":"2024-04-17T02:22:21.265155+0000","last_active":"2024-04-17T02:22:23.962096+0000","last_peered":"2024-04-17T02:22:23.962096+0000","last_clean":"2024-04-17T02:22:23.962096+0000","last_became_active":"2024-04-17T02:22:21.263791+0000","last_became_peered":"2024-04-17T02:22:21.263791+0000","last_unstale":"2024-04-17T02:22:23.962096+0000","last_undegraded":"2024-04-17T02:22:23.962096+0000","last_fullsized":"2024-04-17T02:22:23.962096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:29:08.387822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963208+0000","last_change":"2024-04-17T02:22:22.275017+0000","last_active":"2024-04-17T02:22:23.963208+0000","last_peered":"2024-04-17T02:22:23.963208+0000","last_clean":"2024-04-17T02:22:23.963208+0000","last_became_active":"2024-04-17T02:22:22.273465+0000","last_became_peered":"2024-04-17T02:22:22.273465+0000","last_unstale":"2024-04-17T02:22:23.963208+0000","last_undegraded":"2024-04-17T02:22:23.963208+0000","last_fullsized":"2024-04-17T02:22:23.963208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:44:17.761493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245862+0000","last_change":"2024-04-17T02:22:17.123761+0000","last_active":"2024-04-17T02:22:23.245862+0000","last_peered":"2024-04-17T02:22:23.245862+0000","last_clean":"2024-04-17T02:22:23.245862+0000","last_became_active":"2024-04-17T02:22:17.123264+0000","last_became_peered":"2024-04-17T02:22:17.123264+0000","last_unstale":"2024-04-17T02:22:23.245862+0000","last_undegraded":"2024-04-17T02:22:23.245862+0000","last_fullsized":"2024-04-17T02:22:23.245862+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:51:28.918451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245315+0000","last_change":"2024-04-17T02:22:21.262295+0000","last_active":"2024-04-17T02:22:23.245315+0000","last_peered":"2024-04-17T02:22:23.245315+0000","last_clean":"2024-04-17T02:22:23.245315+0000","last_became_active":"2024-04-17T02:22:21.261890+0000","last_became_peered":"2024-04-17T02:22:21.261890+0000","last_unstale":"2024-04-17T02:22:23.245315+0000","last_undegraded":"2024-04-17T02:22:23.245315+0000","last_fullsized":"2024-04-17T02:22:23.245315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:31:33.861752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963136+0000","last_change":"2024-04-17T02:22:22.275199+0000","last_active":"2024-04-17T02:22:23.963136+0000","last_peered":"2024-04-17T02:22:23.963136+0000","last_clean":"2024-04-17T02:22:23.963136+0000","last_became_active":"2024-04-17T02:22:22.274892+0000","last_became_peered":"2024-04-17T02:22:22.274892+0000","last_unstale":"2024-04-17T02:22:23.963136+0000","last_undegraded":"2024-04-17T02:22:23.963136+0000","last_fullsized":"2024-04-17T02:22:23.963136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:58:55.176237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246122+0000","last_change":"2024-04-17T02:22:21.256839+0000","last_active":"2024-04-17T02:22:23.246122+0000","last_peered":"2024-04-17T02:22:23.246122+0000","last_clean":"2024-04-17T02:22:23.246122+0000","last_became_active":"2024-04-17T02:22:21.255764+0000","last_became_peered":"2024-04-17T02:22:21.255764+0000","last_unstale":"2024-04-17T02:22:23.246122+0000","last_undegraded":"2024-04-17T02:22:23.246122+0000","last_fullsized":"2024-04-17T02:22:23.246122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:05:15.621470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963324+0000","last_change":"2024-04-17T02:22:17.560478+0000","last_active":"2024-04-17T02:22:23.963324+0000","last_peered":"2024-04-17T02:22:23.963324+0000","last_clean":"2024-04-17T02:22:23.963324+0000","last_became_active":"2024-04-17T02:22:17.560133+0000","last_became_peered":"2024-04-17T02:22:17.560133+0000","last_unstale":"2024-04-17T02:22:23.963324+0000","last_undegraded":"2024-04-17T02:22:23.963324+0000","last_fullsized":"2024-04-17T02:22:23.963324+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:36:01.410663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962278+0000","last_change":"2024-04-17T02:22:22.277210+0000","last_active":"2024-04-17T02:22:23.962278+0000","last_peered":"2024-04-17T02:22:23.962278+0000","last_clean":"2024-04-17T02:22:23.962278+0000","last_became_active":"2024-04-17T02:22:22.275055+0000","last_became_peered":"2024-04-17T02:22:22.275055+0000","last_unstale":"2024-04-17T02:22:23.962278+0000","last_undegraded":"2024-04-17T02:22:23.962278+0000","last_fullsized":"2024-04-17T02:22:23.962278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:59:56.366536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963255+0000","last_change":"2024-04-17T02:22:21.259328+0000","last_active":"2024-04-17T02:22:23.963255+0000","last_peered":"2024-04-17T02:22:23.963255+0000","last_clean":"2024-04-17T02:22:23.963255+0000","last_became_active":"2024-04-17T02:22:21.259133+0000","last_became_peered":"2024-04-17T02:22:21.259133+0000","last_unstale":"2024-04-17T02:22:23.963255+0000","last_undegraded":"2024-04-17T02:22:23.963255+0000","last_fullsized":"2024-04-17T02:22:23.963255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:36:10.793622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246164+0000","last_change":"2024-04-17T02:22:17.124496+0000","last_active":"2024-04-17T02:22:23.246164+0000","last_peered":"2024-04-17T02:22:23.246164+0000","last_clean":"2024-04-17T02:22:23.246164+0000","last_became_active":"2024-04-17T02:22:17.123440+0000","last_became_peered":"2024-04-17T02:22:17.123440+0000","last_unstale":"2024-04-17T02:22:23.246164+0000","last_undegraded":"2024-04-17T02:22:23.246164+0000","last_fullsized":"2024-04-17T02:22:23.246164+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:29:11.971454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962511+0000","last_change":"2024-04-17T02:22:22.268601+0000","last_active":"2024-04-17T02:22:23.962511+0000","last_peered":"2024-04-17T02:22:23.962511+0000","last_clean":"2024-04-17T02:22:23.962511+0000","last_became_active":"2024-04-17T02:22:22.267752+0000","last_became_peered":"2024-04-17T02:22:22.267752+0000","last_unstale":"2024-04-17T02:22:23.962511+0000","last_undegraded":"2024-04-17T02:22:23.962511+0000","last_fullsized":"2024-04-17T02:22:23.962511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:24:39.123134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248403+0000","last_change":"2024-04-17T02:22:21.265332+0000","last_active":"2024-04-17T02:22:23.248403+0000","last_peered":"2024-04-17T02:22:23.248403+0000","last_clean":"2024-04-17T02:22:23.248403+0000","last_became_active":"2024-04-17T02:22:21.265029+0000","last_became_peered":"2024-04-17T02:22:21.265029+0000","last_unstale":"2024-04-17T02:22:23.248403+0000","last_undegraded":"2024-04-17T02:22:23.248403+0000","last_fullsized":"2024-04-17T02:22:23.248403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:34:47.001187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963263+0000","last_change":"2024-04-17T02:22:17.121783+0000","last_active":"2024-04-17T02:22:23.963263+0000","last_peered":"2024-04-17T02:22:23.963263+0000","last_clean":"2024-04-17T02:22:23.963263+0000","last_became_active":"2024-04-17T02:22:17.121502+0000","last_became_peered":"2024-04-17T02:22:17.121502+0000","last_unstale":"2024-04-17T02:22:23.963263+0000","last_undegraded":"2024-04-17T02:22:23.963263+0000","last_fullsized":"2024-04-17T02:22:23.963263+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:05:41.795170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247296+0000","last_change":"2024-04-17T02:22:22.279268+0000","last_active":"2024-04-17T02:22:23.247296+0000","last_peered":"2024-04-17T02:22:23.247296+0000","last_clean":"2024-04-17T02:22:23.247296+0000","last_became_active":"2024-04-17T02:22:22.278986+0000","last_became_peered":"2024-04-17T02:22:22.278986+0000","last_unstale":"2024-04-17T02:22:23.247296+0000","last_undegraded":"2024-04-17T02:22:23.247296+0000","last_fullsized":"2024-04-17T02:22:23.247296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:27:10.507427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:24.246277+0000","last_change":"2024-04-17T02:22:21.261825+0000","last_active":"2024-04-17T02:22:24.246277+0000","last_peered":"2024-04-17T02:22:24.246277+0000","last_clean":"2024-04-17T02:22:24.246277+0000","last_became_active":"2024-04-17T02:22:21.261319+0000","last_became_peered":"2024-04-17T02:22:21.261319+0000","last_unstale":"2024-04-17T02:22:24.246277+0000","last_undegraded":"2024-04-17T02:22:24.246277+0000","last_fullsized":"2024-04-17T02:22:24.246277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:43:22.970177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245937+0000","last_change":"2024-04-17T02:22:17.123744+0000","last_active":"2024-04-17T02:22:23.245937+0000","last_peered":"2024-04-17T02:22:23.245937+0000","last_clean":"2024-04-17T02:22:23.245937+0000","last_became_active":"2024-04-17T02:22:17.123322+0000","last_became_peered":"2024-04-17T02:22:17.123322+0000","last_unstale":"2024-04-17T02:22:23.245937+0000","last_undegraded":"2024-04-17T02:22:23.245937+0000","last_fullsized":"2024-04-17T02:22:23.245937+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:36:41.743830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246504+0000","last_change":"2024-04-17T02:22:22.249162+0000","last_active":"2024-04-17T02:22:23.246504+0000","last_peered":"2024-04-17T02:22:23.246504+0000","last_clean":"2024-04-17T02:22:23.246504+0000","last_became_active":"2024-04-17T02:22:22.248758+0000","last_became_peered":"2024-04-17T02:22:22.248758+0000","last_unstale":"2024-04-17T02:22:23.246504+0000","last_undegraded":"2024-04-17T02:22:23.246504+0000","last_fullsized":"2024-04-17T02:22:23.246504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:18:48.496574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247007+0000","last_change":"2024-04-17T02:22:22.254193+0000","last_active":"2024-04-17T02:22:23.247007+0000","last_peered":"2024-04-17T02:22:23.247007+0000","last_clean":"2024-04-17T02:22:23.247007+0000","last_became_active":"2024-04-17T02:22:22.253786+0000","last_became_peered":"2024-04-17T02:22:22.253786+0000","last_unstale":"2024-04-17T02:22:23.247007+0000","last_undegraded":"2024-04-17T02:22:23.247007+0000","last_fullsized":"2024-04-17T02:22:23.247007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:35:40.664294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245532+0000","last_change":"2024-04-17T02:22:21.248985+0000","last_active":"2024-04-17T02:22:23.245532+0000","last_peered":"2024-04-17T02:22:23.245532+0000","last_clean":"2024-04-17T02:22:23.245532+0000","last_became_active":"2024-04-17T02:22:21.248664+0000","last_became_peered":"2024-04-17T02:22:21.248664+0000","last_unstale":"2024-04-17T02:22:23.245532+0000","last_undegraded":"2024-04-17T02:22:23.245532+0000","last_fullsized":"2024-04-17T02:22:23.245532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:35:39.662298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962584+0000","last_change":"2024-04-17T02:22:22.273634+0000","last_active":"2024-04-17T02:22:23.962584+0000","last_peered":"2024-04-17T02:22:23.962584+0000","last_clean":"2024-04-17T02:22:23.962584+0000","last_became_active":"2024-04-17T02:22:22.273338+0000","last_became_peered":"2024-04-17T02:22:22.273338+0000","last_unstale":"2024-04-17T02:22:23.962584+0000","last_undegraded":"2024-04-17T02:22:23.962584+0000","last_fullsized":"2024-04-17T02:22:23.962584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:06:11.399207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247114+0000","last_change":"2024-04-17T02:22:21.253661+0000","last_active":"2024-04-17T02:22:23.247114+0000","last_peered":"2024-04-17T02:22:23.247114+0000","last_clean":"2024-04-17T02:22:23.247114+0000","last_became_active":"2024-04-17T02:22:21.253375+0000","last_became_peered":"2024-04-17T02:22:21.253375+0000","last_unstale":"2024-04-17T02:22:23.247114+0000","last_undegraded":"2024-04-17T02:22:23.247114+0000","last_fullsized":"2024-04-17T02:22:23.247114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:36:45.870213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245991+0000","last_change":"2024-04-17T02:22:21.261955+0000","last_active":"2024-04-17T02:22:23.245991+0000","last_peered":"2024-04-17T02:22:23.245991+0000","last_clean":"2024-04-17T02:22:23.245991+0000","last_became_active":"2024-04-17T02:22:21.261671+0000","last_became_peered":"2024-04-17T02:22:21.261671+0000","last_unstale":"2024-04-17T02:22:23.245991+0000","last_undegraded":"2024-04-17T02:22:23.245991+0000","last_fullsized":"2024-04-17T02:22:23.245991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:58:48.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248551+0000","last_change":"2024-04-17T02:22:22.259450+0000","last_active":"2024-04-17T02:22:23.248551+0000","last_peered":"2024-04-17T02:22:23.248551+0000","last_clean":"2024-04-17T02:22:23.248551+0000","last_became_active":"2024-04-17T02:22:22.259173+0000","last_became_peered":"2024-04-17T02:22:22.259173+0000","last_unstale":"2024-04-17T02:22:23.248551+0000","last_undegraded":"2024-04-17T02:22:23.248551+0000","last_fullsized":"2024-04-17T02:22:23.248551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:33:01.850142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963409+0000","last_change":"2024-04-17T02:22:21.261243+0000","last_active":"2024-04-17T02:22:23.963409+0000","last_peered":"2024-04-17T02:22:23.963409+0000","last_clean":"2024-04-17T02:22:23.963409+0000","last_became_active":"2024-04-17T02:22:21.260251+0000","last_became_peered":"2024-04-17T02:22:21.260251+0000","last_unstale":"2024-04-17T02:22:23.963409+0000","last_undegraded":"2024-04-17T02:22:23.963409+0000","last_fullsized":"2024-04-17T02:22:23.963409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:04:55.664715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247132+0000","last_change":"2024-04-17T02:22:22.279329+0000","last_active":"2024-04-17T02:22:23.247132+0000","last_peered":"2024-04-17T02:22:23.247132+0000","last_clean":"2024-04-17T02:22:23.247132+0000","last_became_active":"2024-04-17T02:22:22.278952+0000","last_became_peered":"2024-04-17T02:22:22.278952+0000","last_unstale":"2024-04-17T02:22:23.247132+0000","last_undegraded":"2024-04-17T02:22:23.247132+0000","last_fullsized":"2024-04-17T02:22:23.247132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:05:16.623466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245889+0000","last_change":"2024-04-17T02:22:22.259026+0000","last_active":"2024-04-17T02:22:23.245889+0000","last_peered":"2024-04-17T02:22:23.245889+0000","last_clean":"2024-04-17T02:22:23.245889+0000","last_became_active":"2024-04-17T02:22:22.258727+0000","last_became_peered":"2024-04-17T02:22:22.258727+0000","last_unstale":"2024-04-17T02:22:23.245889+0000","last_undegraded":"2024-04-17T02:22:23.245889+0000","last_fullsized":"2024-04-17T02:22:23.245889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:49:55.581353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247317+0000","last_change":"2024-04-17T02:22:21.266400+0000","last_active":"2024-04-17T02:22:23.247317+0000","last_peered":"2024-04-17T02:22:23.247317+0000","last_clean":"2024-04-17T02:22:23.247317+0000","last_became_active":"2024-04-17T02:22:21.266106+0000","last_became_peered":"2024-04-17T02:22:21.266106+0000","last_unstale":"2024-04-17T02:22:23.247317+0000","last_undegraded":"2024-04-17T02:22:23.247317+0000","last_fullsized":"2024-04-17T02:22:23.247317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:17:38.056686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963025+0000","last_change":"2024-04-17T02:22:22.275393+0000","last_active":"2024-04-17T02:22:23.963025+0000","last_peered":"2024-04-17T02:22:23.963025+0000","last_clean":"2024-04-17T02:22:23.963025+0000","last_became_active":"2024-04-17T02:22:22.273656+0000","last_became_peered":"2024-04-17T02:22:22.273656+0000","last_unstale":"2024-04-17T02:22:23.963025+0000","last_undegraded":"2024-04-17T02:22:23.963025+0000","last_fullsized":"2024-04-17T02:22:23.963025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:09:57.616528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962374+0000","last_change":"2024-04-17T02:22:21.263049+0000","last_active":"2024-04-17T02:22:23.962374+0000","last_peered":"2024-04-17T02:22:23.962374+0000","last_clean":"2024-04-17T02:22:23.962374+0000","last_became_active":"2024-04-17T02:22:21.262318+0000","last_became_peered":"2024-04-17T02:22:21.262318+0000","last_unstale":"2024-04-17T02:22:23.962374+0000","last_undegraded":"2024-04-17T02:22:23.962374+0000","last_fullsized":"2024-04-17T02:22:23.962374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:06:57.393992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247996+0000","last_change":"2024-04-17T02:22:22.269974+0000","last_active":"2024-04-17T02:22:23.247996+0000","last_peered":"2024-04-17T02:22:23.247996+0000","last_clean":"2024-04-17T02:22:23.247996+0000","last_became_active":"2024-04-17T02:22:22.269670+0000","last_became_peered":"2024-04-17T02:22:22.269670+0000","last_unstale":"2024-04-17T02:22:23.247996+0000","last_undegraded":"2024-04-17T02:22:23.247996+0000","last_fullsized":"2024-04-17T02:22:23.247996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:40:01.962151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245667+0000","last_change":"2024-04-17T02:22:21.264230+0000","last_active":"2024-04-17T02:22:23.245667+0000","last_peered":"2024-04-17T02:22:23.245667+0000","last_clean":"2024-04-17T02:22:23.245667+0000","last_became_active":"2024-04-17T02:22:21.263922+0000","last_became_peered":"2024-04-17T02:22:21.263922+0000","last_unstale":"2024-04-17T02:22:23.245667+0000","last_undegraded":"2024-04-17T02:22:23.245667+0000","last_fullsized":"2024-04-17T02:22:23.245667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:42:08.530787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246821+0000","last_change":"2024-04-17T02:22:22.272294+0000","last_active":"2024-04-17T02:22:23.246821+0000","last_peered":"2024-04-17T02:22:23.246821+0000","last_clean":"2024-04-17T02:22:23.246821+0000","last_became_active":"2024-04-17T02:22:22.272022+0000","last_became_peered":"2024-04-17T02:22:22.272022+0000","last_unstale":"2024-04-17T02:22:23.246821+0000","last_undegraded":"2024-04-17T02:22:23.246821+0000","last_fullsized":"2024-04-17T02:22:23.246821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:04:01.559523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248286+0000","last_change":"2024-04-17T02:22:21.260781+0000","last_active":"2024-04-17T02:22:23.248286+0000","last_peered":"2024-04-17T02:22:23.248286+0000","last_clean":"2024-04-17T02:22:23.248286+0000","last_became_active":"2024-04-17T02:22:21.260216+0000","last_became_peered":"2024-04-17T02:22:21.260216+0000","last_unstale":"2024-04-17T02:22:23.248286+0000","last_undegraded":"2024-04-17T02:22:23.248286+0000","last_fullsized":"2024-04-17T02:22:23.248286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:25:57.151354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246613+0000","last_change":"2024-04-17T02:22:22.260715+0000","last_active":"2024-04-17T02:22:23.246613+0000","last_peered":"2024-04-17T02:22:23.246613+0000","last_clean":"2024-04-17T02:22:23.246613+0000","last_became_active":"2024-04-17T02:22:22.260292+0000","last_became_peered":"2024-04-17T02:22:22.260292+0000","last_unstale":"2024-04-17T02:22:23.246613+0000","last_undegraded":"2024-04-17T02:22:23.246613+0000","last_fullsized":"2024-04-17T02:22:23.246613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:04:56.666711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963098+0000","last_change":"2024-04-17T02:22:21.263024+0000","last_active":"2024-04-17T02:22:23.963098+0000","last_peered":"2024-04-17T02:22:23.963098+0000","last_clean":"2024-04-17T02:22:23.963098+0000","last_became_active":"2024-04-17T02:22:21.262335+0000","last_became_peered":"2024-04-17T02:22:21.262335+0000","last_unstale":"2024-04-17T02:22:23.963098+0000","last_undegraded":"2024-04-17T02:22:23.963098+0000","last_fullsized":"2024-04-17T02:22:23.963098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:21:11.268956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245289+0000","last_change":"2024-04-17T02:22:22.251488+0000","last_active":"2024-04-17T02:22:23.245289+0000","last_peered":"2024-04-17T02:22:23.245289+0000","last_clean":"2024-04-17T02:22:23.245289+0000","last_became_active":"2024-04-17T02:22:22.251111+0000","last_became_peered":"2024-04-17T02:22:22.251111+0000","last_unstale":"2024-04-17T02:22:23.245289+0000","last_undegraded":"2024-04-17T02:22:23.245289+0000","last_fullsized":"2024-04-17T02:22:23.245289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:43:59.776760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245935+0000","last_change":"2024-04-17T02:22:21.257583+0000","last_active":"2024-04-17T02:22:23.245935+0000","last_peered":"2024-04-17T02:22:23.245935+0000","last_clean":"2024-04-17T02:22:23.245935+0000","last_became_active":"2024-04-17T02:22:21.257330+0000","last_became_peered":"2024-04-17T02:22:21.257330+0000","last_unstale":"2024-04-17T02:22:23.245935+0000","last_undegraded":"2024-04-17T02:22:23.245935+0000","last_fullsized":"2024-04-17T02:22:23.245935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:26:37.106505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248640+0000","last_change":"2024-04-17T02:22:22.264602+0000","last_active":"2024-04-17T02:22:23.248640+0000","last_peered":"2024-04-17T02:22:23.248640+0000","last_clean":"2024-04-17T02:22:23.248640+0000","last_became_active":"2024-04-17T02:22:22.264319+0000","last_became_peered":"2024-04-17T02:22:22.264319+0000","last_unstale":"2024-04-17T02:22:23.248640+0000","last_undegraded":"2024-04-17T02:22:23.248640+0000","last_fullsized":"2024-04-17T02:22:23.248640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:45:35.746928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248295+0000","last_change":"2024-04-17T02:22:21.259254+0000","last_active":"2024-04-17T02:22:23.248295+0000","last_peered":"2024-04-17T02:22:23.248295+0000","last_clean":"2024-04-17T02:22:23.248295+0000","last_became_active":"2024-04-17T02:22:21.258944+0000","last_became_peered":"2024-04-17T02:22:21.258944+0000","last_unstale":"2024-04-17T02:22:23.248295+0000","last_undegraded":"2024-04-17T02:22:23.248295+0000","last_fullsized":"2024-04-17T02:22:23.248295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:21:11.268956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245623+0000","last_change":"2024-04-17T02:22:22.276249+0000","last_active":"2024-04-17T02:22:23.245623+0000","last_peered":"2024-04-17T02:22:23.245623+0000","last_clean":"2024-04-17T02:22:23.245623+0000","last_became_active":"2024-04-17T02:22:22.275817+0000","last_became_peered":"2024-04-17T02:22:22.275817+0000","last_unstale":"2024-04-17T02:22:23.245623+0000","last_undegraded":"2024-04-17T02:22:23.245623+0000","last_fullsized":"2024-04-17T02:22:23.245623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:44:37.302631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963340+0000","last_change":"2024-04-17T02:22:21.260966+0000","last_active":"2024-04-17T02:22:23.963340+0000","last_peered":"2024-04-17T02:22:23.963340+0000","last_clean":"2024-04-17T02:22:23.963340+0000","last_became_active":"2024-04-17T02:22:21.260540+0000","last_became_peered":"2024-04-17T02:22:21.260540+0000","last_unstale":"2024-04-17T02:22:23.963340+0000","last_undegraded":"2024-04-17T02:22:23.963340+0000","last_fullsized":"2024-04-17T02:22:23.963340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:18:47.494578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65024,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":63778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":656236,"data_compressed":32512,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":654556,"data_compressed":32512,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":208896,"data_stored":65322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32512,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32512,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T02:22:30.047 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-17T02:22:30.047 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-17T02:22:30.048 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-17T02:22:30.048 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-17T02:22:30.048 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-17T02:22:30.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.187+0000 7fec2c50e640 1 Processor -- start 2024-04-17T02:22:30.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.187+0000 7fec2c50e640 1 -- start start 2024-04-17T02:22:30.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.188+0000 7fec2c50e640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fec240bb460 0x7fec24142580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:30.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.188+0000 7fec2c50e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fec24142ac0 0x7fec2414fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:30.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.188+0000 7fec2c50e640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec240acea0 con 0x7fec240ab5b0 2024-04-17T02:22:30.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.188+0000 7fec2c50e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fec240ab990 con 0x7fec24142ac0 2024-04-17T02:22:30.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.188+0000 7fec2c50e640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fec2406c330 con 0x7fec240bb460 2024-04-17T02:22:30.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.188+0000 7fec2aaab640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fec24142ac0 0x7fec2414fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:30.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.188+0000 7fec29aa9640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fec240bb460 0x7fec24142580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:30.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.188+0000 7fec2aaab640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fec24142ac0 0x7fec2414fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44642/0 (socket says 172.21.15.17:44642) 2024-04-17T02:22:30.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.188+0000 7fec2aaab640 1 -- 172.21.15.17:0/734761957 learned_addr learned my addr 172.21.15.17:0/734761957 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:30.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.189+0000 7fec2aaab640 1 -- 172.21.15.17:0/734761957 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fec240bb460 msgr2=0x7fec24142580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:30.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.189+0000 7fec2aaab640 1 --2- 172.21.15.17:0/734761957 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fec240bb460 0x7fec24142580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:30.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.189+0000 7fec2aaab640 1 -- 172.21.15.17:0/734761957 >> v1:172.21.15.122:6789/0 conn(0x7fec240ab5b0 legacy=0x7fec240ac680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:30.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.189+0000 7fec2aaab640 1 -- 172.21.15.17:0/734761957 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec2406dd30 con 0x7fec24142ac0 2024-04-17T02:22:30.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.189+0000 7fec29aa9640 1 --2- 172.21.15.17:0/734761957 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fec240bb460 0x7fec24142580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:30.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.189+0000 7fec2aaab640 1 --2- 172.21.15.17:0/734761957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec24142ac0 0x7fec2414fa90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fec14009e50 tx=0x7fec1402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2af57eef8aebef18 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:30.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.190+0000 7fec292a8640 1 -- 172.21.15.17:0/734761957 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec1402ca70 con 0x7fec24142ac0 2024-04-17T02:22:30.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.190+0000 7fec292a8640 1 -- 172.21.15.17:0/734761957 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec1402cc10 con 0x7fec24142ac0 2024-04-17T02:22:30.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.190+0000 7fec292a8640 1 -- 172.21.15.17:0/734761957 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec140343f0 con 0x7fec24142ac0 2024-04-17T02:22:30.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.190+0000 7fec2c50e640 1 -- 172.21.15.17:0/734761957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec24142ac0 msgr2=0x7fec2414fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:30.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.190+0000 7fec2c50e640 1 --2- 172.21.15.17:0/734761957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec24142ac0 0x7fec2414fa90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fec14009e50 tx=0x7fec1402bed0 comp rx=0 tx=0).stop 2024-04-17T02:22:30.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.190+0000 7fec2c50e640 1 -- 172.21.15.17:0/734761957 shutdown_connections 2024-04-17T02:22:30.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.190+0000 7fec2c50e640 1 --2- 172.21.15.17:0/734761957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec24142ac0 0x7fec2414fa90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:30.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.190+0000 7fec2c50e640 1 --2- 172.21.15.17:0/734761957 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fec240bb460 0x7fec24142580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:30.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.190+0000 7fec2c50e640 1 -- 172.21.15.17:0/734761957 >> 172.21.15.17:0/734761957 conn(0x7fec240ba940 msgr2=0x7fec240bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:30.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.190+0000 7fec2c50e640 1 -- 172.21.15.17:0/734761957 shutdown_connections 2024-04-17T02:22:30.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.190+0000 7fec2c50e640 1 -- 172.21.15.17:0/734761957 wait complete. 2024-04-17T02:22:30.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.191+0000 7fec2c50e640 1 Processor -- start 2024-04-17T02:22:30.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.191+0000 7fec2c50e640 1 -- start start 2024-04-17T02:22:30.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.192+0000 7fec2c50e640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fec240ab5b0 0x7fec2413eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:30.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.192+0000 7fec2c50e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec240bb460 0x7fec24148170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:30.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.192+0000 7fec2c50e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec24142ac0 0x7fec2413b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:30.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.192+0000 7fec2c50e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fec240a9880 con 0x7fec24142ac0 2024-04-17T02:22:30.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.192+0000 7fec2c50e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fec240a9700 con 0x7fec240bb460 2024-04-17T02:22:30.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.192+0000 7fec2c50e640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fec2414ffd0 con 0x7fec240ab5b0 2024-04-17T02:22:30.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.192+0000 7fec2a2aa640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fec240ab5b0 0x7fec2413eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:30.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.192+0000 7fec2aaab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec24142ac0 0x7fec2413b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:30.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.192+0000 7fec2aaab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec24142ac0 0x7fec2413b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44654/0 (socket says 172.21.15.17:44654) 2024-04-17T02:22:30.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.192+0000 7fec2a2aa640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fec240ab5b0 0x7fec2413eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:58116/0 (socket says 172.21.15.17:58116) 2024-04-17T02:22:30.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.192+0000 7fec2aaab640 1 -- 172.21.15.17:0/3746129544 learned_addr learned my addr 172.21.15.17:0/3746129544 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:30.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.192+0000 7fec29aa9640 1 --2- 172.21.15.17:0/3746129544 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec240bb460 0x7fec24148170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:30.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.192+0000 7fec2a2aa640 1 -- 172.21.15.17:0/3746129544 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec240bb460 msgr2=0x7fec24148170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:30.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.192+0000 7fec2a2aa640 1 --2- 172.21.15.17:0/3746129544 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec240bb460 0x7fec24148170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:30.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.192+0000 7fec2a2aa640 1 -- 172.21.15.17:0/3746129544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec24142ac0 msgr2=0x7fec2413b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:30.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.192+0000 7fec2a2aa640 1 --2- 172.21.15.17:0/3746129544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec24142ac0 0x7fec2413b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:30.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.192+0000 7fec2a2aa640 1 -- 172.21.15.17:0/3746129544 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec240ba010 con 0x7fec240ab5b0 2024-04-17T02:22:30.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.192+0000 7fec2aaab640 1 --2- 172.21.15.17:0/3746129544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec24142ac0 0x7fec2413b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:30.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.192+0000 7fec2a2aa640 1 --2- 172.21.15.17:0/3746129544 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fec240ab5b0 0x7fec2413eae0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fec1c00c440 tx=0x7fec1c00c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:30.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.192+0000 7fec22ffd640 1 -- 172.21.15.17:0/3746129544 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec1c011790 con 0x7fec240ab5b0 2024-04-17T02:22:30.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.192+0000 7fec22ffd640 1 -- 172.21.15.17:0/3746129544 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec1c017070 con 0x7fec240ab5b0 2024-04-17T02:22:30.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.192+0000 7fec2c50e640 1 -- 172.21.15.17:0/3746129544 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec24146a50 con 0x7fec240ab5b0 2024-04-17T02:22:30.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.192+0000 7fec22ffd640 1 -- 172.21.15.17:0/3746129544 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec1c011b70 con 0x7fec240ab5b0 2024-04-17T02:22:30.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.193+0000 7fec2c50e640 1 -- 172.21.15.17:0/3746129544 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fec24146110 con 0x7fec240ab5b0 2024-04-17T02:22:30.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.193+0000 7fec2c50e640 1 -- 172.21.15.17:0/3746129544 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec240687f0 con 0x7fec240ab5b0 2024-04-17T02:22:30.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.195+0000 7fec22ffd640 1 -- 172.21.15.17:0/3746129544 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7fec1c011d10 con 0x7fec240ab5b0 2024-04-17T02:22:30.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.195+0000 7fec22ffd640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:30.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.196+0000 7fec22ffd640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:30.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.196+0000 7fec22ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:30.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.196+0000 7fec22ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:30.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.196+0000 7fec22ffd640 1 --2- 172.21.15.17:0/3746129544 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fec1009f480 0x7fec100a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:30.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.196+0000 7fec29aa9640 1 --2- 172.21.15.17:0/3746129544 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fec1009f480 0x7fec100a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:30.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.196+0000 7fec22ffd640 1 -- 172.21.15.17:0/3746129544 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7fec1c0c9c40 con 0x7fec240ab5b0 2024-04-17T02:22:30.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.196+0000 7fec29aa9640 1 --2- 172.21.15.17:0/3746129544 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fec1009f480 0x7fec100a1940 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fec24141850 tx=0x7fec18008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:30.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.199+0000 7fec22ffd640 1 -- 172.21.15.17:0/3746129544 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fec1c098ca0 con 0x7fec240ab5b0 2024-04-17T02:22:30.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.431+0000 7fec2c50e640 1 -- 172.21.15.17:0/3746129544 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fec240ba260 con 0x7fec240ab5b0 2024-04-17T02:22:30.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.436+0000 7fec22ffd640 1 -- 172.21.15.17:0/3746129544 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+257833 (secure 0 0 0) 0x7fec1c0985a0 con 0x7fec240ab5b0 2024-04-17T02:22:30.440 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:22:30.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.439+0000 7fec2c50e640 10 mgrc shutdown 2024-04-17T02:22:30.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.439+0000 7fec2c50e640 1 -- 172.21.15.17:0/3746129544 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fec1009f480 msgr2=0x7fec100a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:30.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.439+0000 7fec2c50e640 1 --2- 172.21.15.17:0/3746129544 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fec1009f480 0x7fec100a1940 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fec24141850 tx=0x7fec18008040 comp rx=0 tx=0).stop 2024-04-17T02:22:30.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.439+0000 7fec2c50e640 1 -- 172.21.15.17:0/3746129544 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fec240ab5b0 msgr2=0x7fec2413eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:30.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.439+0000 7fec2c50e640 1 --2- 172.21.15.17:0/3746129544 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fec240ab5b0 0x7fec2413eae0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fec1c00c440 tx=0x7fec1c00c900 comp rx=0 tx=0).stop 2024-04-17T02:22:30.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.439+0000 7fec2c50e640 1 -- 172.21.15.17:0/3746129544 shutdown_connections 2024-04-17T02:22:30.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.439+0000 7fec2c50e640 1 --2- 172.21.15.17:0/3746129544 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fec1009f480 0x7fec100a1940 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:30.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.439+0000 7fec2c50e640 1 --2- 172.21.15.17:0/3746129544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec24142ac0 0x7fec2413b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:30.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.439+0000 7fec2c50e640 1 --2- 172.21.15.17:0/3746129544 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec240bb460 0x7fec24148170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:30.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.439+0000 7fec2c50e640 1 --2- 172.21.15.17:0/3746129544 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fec240ab5b0 0x7fec2413eae0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:30.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.439+0000 7fec2c50e640 1 -- 172.21.15.17:0/3746129544 >> 172.21.15.17:0/3746129544 conn(0x7fec240ba940 msgr2=0x7fec2413f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:30.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.439+0000 7fec2c50e640 1 -- 172.21.15.17:0/3746129544 shutdown_connections 2024-04-17T02:22:30.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.439+0000 7fec2c50e640 1 -- 172.21.15.17:0/3746129544 wait complete. 2024-04-17T02:22:30.450 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":5,"flags":0,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":563692809},{"type":"v1","addr":"172.21.15.17:6809","nonce":563692809}]},"active_addr":"172.21.15.17:6809/563692809","active_change":"2024-04-17T02:22:04.497087+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4108,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":4111,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":1005366410}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":3453247726}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":3759303517}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":3236923389}]}]} 2024-04-17T02:22:30.456 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-17T02:22:30.456 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-17T02:22:30.456 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T02:22:30.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.594+0000 7f3b609fb640 1 Processor -- start 2024-04-17T02:22:30.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.594+0000 7f3b609fb640 1 -- start start 2024-04-17T02:22:30.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.595+0000 7f3b609fb640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3b5c0a9560 0x7f3b5c145730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:30.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.595+0000 7f3b609fb640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f3b5c145c70 0x7f3b5c14f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:30.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.595+0000 7f3b609fb640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b5c0a7f00 con 0x7f3b5c0ab3b0 2024-04-17T02:22:30.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.595+0000 7f3b609fb640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f3b5c0abd20 con 0x7f3b5c0a9560 2024-04-17T02:22:30.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.595+0000 7f3b609fb640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f3b5c0ac000 con 0x7f3b5c145c70 2024-04-17T02:22:30.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.595+0000 7f3b5ad9d640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f3b5c145c70 0x7f3b5c14f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:30.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.595+0000 7f3b5ad9d640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f3b5c145c70 0x7f3b5c14f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:52930/0 (socket says 172.21.15.17:52930) 2024-04-17T02:22:30.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.595+0000 7f3b5ad9d640 1 -- 172.21.15.17:0/260232519 learned_addr learned my addr 172.21.15.17:0/260232519 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:30.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.595+0000 7f3b53fff640 1 --2- 172.21.15.17:0/260232519 >> v2:172.21.15.122:3300/0 conn(0x7f3b5c0a9560 0x7f3b5c145730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:30.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.595+0000 7f3b5ad9d640 1 -- 172.21.15.17:0/260232519 >> v2:172.21.15.122:3300/0 conn(0x7f3b5c0a9560 msgr2=0x7f3b5c145730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:30.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.595+0000 7f3b5ad9d640 1 --2- 172.21.15.17:0/260232519 >> v2:172.21.15.122:3300/0 conn(0x7f3b5c0a9560 0x7f3b5c145730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:30.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.595+0000 7f3b5ad9d640 1 -- 172.21.15.17:0/260232519 >> v1:172.21.15.122:6789/0 conn(0x7f3b5c0ab3b0 legacy=0x7f3b5c0ac7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:30.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.595+0000 7f3b5ad9d640 1 -- 172.21.15.17:0/260232519 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b5c0a7960 con 0x7f3b5c145c70 2024-04-17T02:22:30.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.596+0000 7f3b5ad9d640 1 --2- 172.21.15.17:0/260232519 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f3b5c145c70 0x7f3b5c14f960 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c0a7b90 tx=0x7f3b5402beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df8ee82c4021582b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:30.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.596+0000 7f3b59d9b640 1 -- 172.21.15.17:0/260232519 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5402ca50 con 0x7f3b5c145c70 2024-04-17T02:22:30.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.596+0000 7f3b59d9b640 1 -- 172.21.15.17:0/260232519 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b5402cbf0 con 0x7f3b5c145c70 2024-04-17T02:22:30.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.596+0000 7f3b59d9b640 1 -- 172.21.15.17:0/260232519 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b540343f0 con 0x7f3b5c145c70 2024-04-17T02:22:30.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.596+0000 7f3b609fb640 1 -- 172.21.15.17:0/260232519 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f3b5c145c70 msgr2=0x7f3b5c14f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:30.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.596+0000 7f3b609fb640 1 --2- 172.21.15.17:0/260232519 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f3b5c145c70 0x7f3b5c14f960 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c0a7b90 tx=0x7f3b5402beb0 comp rx=0 tx=0).stop 2024-04-17T02:22:30.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.596+0000 7f3b609fb640 1 -- 172.21.15.17:0/260232519 shutdown_connections 2024-04-17T02:22:30.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.596+0000 7f3b609fb640 1 --2- 172.21.15.17:0/260232519 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f3b5c145c70 0x7f3b5c14f960 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:30.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.596+0000 7f3b609fb640 1 --2- 172.21.15.17:0/260232519 >> v2:172.21.15.122:3300/0 conn(0x7f3b5c0a9560 0x7f3b5c145730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:30.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.597+0000 7f3b609fb640 1 -- 172.21.15.17:0/260232519 >> 172.21.15.17:0/260232519 conn(0x7f3b5c0a9b60 msgr2=0x7f3b5c0a9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:30.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.597+0000 7f3b609fb640 1 -- 172.21.15.17:0/260232519 shutdown_connections 2024-04-17T02:22:30.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.597+0000 7f3b609fb640 1 -- 172.21.15.17:0/260232519 wait complete. 2024-04-17T02:22:30.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.598+0000 7f3b609fb640 1 Processor -- start 2024-04-17T02:22:30.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.598+0000 7f3b609fb640 1 -- start start 2024-04-17T02:22:30.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.598+0000 7f3b609fb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b5c0a9560 0x7f3b5c1d1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:30.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.598+0000 7f3b609fb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b5c0ab3b0 0x7f3b5c141780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:30.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.598+0000 7f3b609fb640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f3b5c145c70 0x7f3b5c0ae960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:30.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.598+0000 7f3b609fb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c06b5b0 con 0x7f3b5c0a9560 2024-04-17T02:22:30.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.598+0000 7f3b609fb640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c0ab790 con 0x7f3b5c0ab3b0 2024-04-17T02:22:30.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.598+0000 7f3b609fb640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f3b5c0af830 con 0x7f3b5c145c70 2024-04-17T02:22:30.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.598+0000 7f3b5ad9d640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f3b5c145c70 0x7f3b5c0ae960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:30.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.598+0000 7f3b5ad9d640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f3b5c145c70 0x7f3b5c0ae960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:52932/0 (socket says 172.21.15.17:52932) 2024-04-17T02:22:30.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.598+0000 7f3b5a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b5c0a9560 0x7f3b5c1d1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:30.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.598+0000 7f3b5ad9d640 1 -- 172.21.15.17:0/1736384167 learned_addr learned my addr 172.21.15.17:0/1736384167 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:30.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.599+0000 7f3b53fff640 1 --2- 172.21.15.17:0/1736384167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b5c0ab3b0 0x7f3b5c141780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:30.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.599+0000 7f3b5ad9d640 1 -- 172.21.15.17:0/1736384167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b5c0ab3b0 msgr2=0x7f3b5c141780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:30.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.599+0000 7f3b5ad9d640 1 --2- 172.21.15.17:0/1736384167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b5c0ab3b0 0x7f3b5c141780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:30.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.599+0000 7f3b5ad9d640 1 -- 172.21.15.17:0/1736384167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b5c0a9560 msgr2=0x7f3b5c1d1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:30.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.599+0000 7f3b5ad9d640 1 --2- 172.21.15.17:0/1736384167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b5c0a9560 0x7f3b5c1d1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:30.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.599+0000 7f3b5ad9d640 1 -- 172.21.15.17:0/1736384167 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b5c0b01b0 con 0x7f3b5c145c70 2024-04-17T02:22:30.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.599+0000 7f3b53fff640 1 --2- 172.21.15.17:0/1736384167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b5c0ab3b0 0x7f3b5c141780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T02:22:30.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.599+0000 7f3b5a59c640 1 --2- 172.21.15.17:0/1736384167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b5c0a9560 0x7f3b5c1d1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:30.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.599+0000 7f3b5ad9d640 1 --2- 172.21.15.17:0/1736384167 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f3b5c145c70 0x7f3b5c0ae960 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3b54009e50 tx=0x7f3b54004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:30.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.599+0000 7f3b52ffd640 1 -- 172.21.15.17:0/1736384167 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b54044020 con 0x7f3b5c145c70 2024-04-17T02:22:30.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.599+0000 7f3b52ffd640 1 -- 172.21.15.17:0/1736384167 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b540406b0 con 0x7f3b5c145c70 2024-04-17T02:22:30.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.599+0000 7f3b609fb640 1 -- 172.21.15.17:0/1736384167 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b5c0b0470 con 0x7f3b5c145c70 2024-04-17T02:22:30.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.599+0000 7f3b52ffd640 1 -- 172.21.15.17:0/1736384167 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b54009510 con 0x7f3b5c145c70 2024-04-17T02:22:30.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.599+0000 7f3b609fb640 1 -- 172.21.15.17:0/1736384167 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b5c1d0d50 con 0x7f3b5c145c70 2024-04-17T02:22:30.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.600+0000 7f3b609fb640 1 -- 172.21.15.17:0/1736384167 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b5c0687f0 con 0x7f3b5c145c70 2024-04-17T02:22:30.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.601+0000 7f3b52ffd640 1 -- 172.21.15.17:0/1736384167 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f3b54047020 con 0x7f3b5c145c70 2024-04-17T02:22:30.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.601+0000 7f3b52ffd640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:30.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.602+0000 7f3b52ffd640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:30.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.602+0000 7f3b52ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:30.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.602+0000 7f3b52ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:30.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.602+0000 7f3b52ffd640 1 --2- 172.21.15.17:0/1736384167 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f3b3c09f480 0x7f3b3c0a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:30.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.602+0000 7f3b5a59c640 1 --2- 172.21.15.17:0/1736384167 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f3b3c09f480 0x7f3b3c0a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:30.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.602+0000 7f3b52ffd640 1 -- 172.21.15.17:0/1736384167 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f3b540ebf00 con 0x7f3b5c145c70 2024-04-17T02:22:30.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.602+0000 7f3b5a59c640 1 --2- 172.21.15.17:0/1736384167 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f3b3c09f480 0x7f3b3c0a1940 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c001b70 tx=0x7f3b4c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:30.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.606+0000 7f3b52ffd640 1 -- 172.21.15.17:0/1736384167 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f3b5404e030 con 0x7f3b5c145c70 2024-04-17T02:22:30.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.788+0000 7f3b609fb640 1 -- 172.21.15.17:0/1736384167 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3b5c143310 con 0x7f3b5c145c70 2024-04-17T02:22:30.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.789+0000 7f3b52ffd640 1 -- 172.21.15.17:0/1736384167 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+13561 (secure 0 0 0) 0x7f3b540baec0 con 0x7f3b5c145c70 2024-04-17T02:22:30.790 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:22:30.790 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":20,"fsid":"7cbfae20-b10d-41da-92b7-cbd5c1632e23","created":"2024-04-17T02:22:00.246446+0000","modified":"2024-04-17T02:22:23.241120+0000","last_up_change":"2024-04-17T02:22:09.077928+0000","last_in_change":"2024-04-17T02:22:01.415384+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T02:22:10.533377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-17T02:22:15.947495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-17T02:22:20.016616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-17T02:22:20.573938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2973665c-6c5e-4688-bffe-72d3bdcf467f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6801","nonce":1828284343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6803","nonce":1828284343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6807","nonce":1828284343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6805","nonce":1828284343}]},"public_addr":"172.21.15.17:6801/1828284343","cluster_addr":"172.21.15.17:6803/1828284343","heartbeat_back_addr":"172.21.15.17:6807/1828284343","heartbeat_front_addr":"172.21.15.17:6805/1828284343","state":["exists","up"]},{"osd":1,"uuid":"a59a034d-19b4-47e8-8ca5-538597b4af1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6809","nonce":2064593011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6811","nonce":2064593011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6815","nonce":2064593011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6813","nonce":2064593011}]},"public_addr":"172.21.15.122:6809/2064593011","cluster_addr":"172.21.15.122:6811/2064593011","heartbeat_back_addr":"172.21.15.122:6815/2064593011","heartbeat_front_addr":"172.21.15.122:6813/2064593011","state":["exists","up"]},{"osd":2,"uuid":"070f4c5f-459f-46ff-b980-05b1ac50c951","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6817","nonce":929092547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6819","nonce":929092547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6823","nonce":929092547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6821","nonce":929092547}]},"public_addr":"172.21.15.122:6817/929092547","cluster_addr":"172.21.15.122:6819/929092547","heartbeat_back_addr":"172.21.15.122:6823/929092547","heartbeat_front_addr":"172.21.15.122:6821/929092547","state":["exists","up"]},{"osd":3,"uuid":"96216a49-a7b6-40eb-bc93-cc8c78a5270a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6801","nonce":204132523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6803","nonce":204132523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6807","nonce":204132523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6805","nonce":204132523}]},"public_addr":"172.21.15.122:6801/204132523","cluster_addr":"172.21.15.122:6803/204132523","heartbeat_back_addr":"172.21.15.122:6807/204132523","heartbeat_front_addr":"172.21.15.122:6805/204132523","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.477173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.522791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.590625+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.480698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T02:22:30.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.791+0000 7f3b609fb640 10 mgrc shutdown 2024-04-17T02:22:30.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.791+0000 7f3b609fb640 1 -- 172.21.15.17:0/1736384167 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f3b3c09f480 msgr2=0x7f3b3c0a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:30.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.791+0000 7f3b609fb640 1 --2- 172.21.15.17:0/1736384167 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f3b3c09f480 0x7f3b3c0a1940 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c001b70 tx=0x7f3b4c009040 comp rx=0 tx=0).stop 2024-04-17T02:22:30.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.791+0000 7f3b609fb640 1 -- 172.21.15.17:0/1736384167 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f3b5c145c70 msgr2=0x7f3b5c0ae960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:30.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.791+0000 7f3b609fb640 1 --2- 172.21.15.17:0/1736384167 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f3b5c145c70 0x7f3b5c0ae960 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3b54009e50 tx=0x7f3b54004a40 comp rx=0 tx=0).stop 2024-04-17T02:22:30.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.791+0000 7f3b609fb640 1 -- 172.21.15.17:0/1736384167 shutdown_connections 2024-04-17T02:22:30.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.791+0000 7f3b609fb640 1 --2- 172.21.15.17:0/1736384167 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f3b3c09f480 0x7f3b3c0a1940 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:30.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.791+0000 7f3b609fb640 1 --2- 172.21.15.17:0/1736384167 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f3b5c145c70 0x7f3b5c0ae960 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:30.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.791+0000 7f3b609fb640 1 --2- 172.21.15.17:0/1736384167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b5c0ab3b0 0x7f3b5c141780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:30.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.791+0000 7f3b609fb640 1 --2- 172.21.15.17:0/1736384167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b5c0a9560 0x7f3b5c1d1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:30.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.791+0000 7f3b609fb640 1 -- 172.21.15.17:0/1736384167 >> 172.21.15.17:0/1736384167 conn(0x7f3b5c0a9b60 msgr2=0x7f3b5c068ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:30.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.791+0000 7f3b609fb640 1 -- 172.21.15.17:0/1736384167 shutdown_connections 2024-04-17T02:22:30.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.792+0000 7f3b609fb640 1 -- 172.21.15.17:0/1736384167 wait complete. 2024-04-17T02:22:30.803 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-17T02:22:30.803 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T02:22:30.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.906+0000 7fee7a67b640 1 Processor -- start 2024-04-17T02:22:30.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.906+0000 7fee7a67b640 1 -- start start 2024-04-17T02:22:30.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.907+0000 7fee7a67b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fee740a0520 0x7fee7406c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:30.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.907+0000 7fee7a67b640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee740a1c60 con 0x7fee740a1750 2024-04-17T02:22:30.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.907+0000 7fee7a67b640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee740a1f20 con 0x7fee7406d5c0 2024-04-17T02:22:30.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.907+0000 7fee7a67b640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fee740a0900 con 0x7fee740a0520 2024-04-17T02:22:30.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.907+0000 7fee78c18640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fee740a1750 0x7fee7414d710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42002/0 (socket says 172.21.15.17:42002) 2024-04-17T02:22:30.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.907+0000 7fee78c18640 1 -- 172.21.15.17:0/1776821785 learned_addr learned my addr 172.21.15.17:0/1776821785 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:22:30.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.907+0000 7fee73fff640 1 --2- 172.21.15.17:0/1776821785 >> v2:172.21.15.122:3300/0 conn(0x7fee740a0520 0x7fee7406c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:30.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.907+0000 7fee737fe640 1 -- 172.21.15.17:0/1776821785 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4147284957 0 0) 0x7fee740a1c60 con 0x7fee740a1750 2024-04-17T02:22:30.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.907+0000 7fee737fe640 1 -- 172.21.15.17:0/1776821785 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee60003520 con 0x7fee740a1750 2024-04-17T02:22:30.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.907+0000 7fee737fe640 1 -- 172.21.15.17:0/1776821785 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2322604831 0 0) 0x7fee60003520 con 0x7fee740a1750 2024-04-17T02:22:30.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.907+0000 7fee737fe640 1 -- 172.21.15.17:0/1776821785 >> v2:172.21.15.122:3300/0 conn(0x7fee740a0520 msgr2=0x7fee7406c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:30.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.907+0000 7fee737fe640 1 --2- 172.21.15.17:0/1776821785 >> v2:172.21.15.122:3300/0 conn(0x7fee740a0520 0x7fee7406c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:30.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.907+0000 7fee737fe640 1 -- 172.21.15.17:0/1776821785 >> v1:172.21.15.122:6789/0 conn(0x7fee7406d5c0 legacy=0x7fee74143510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:30.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.907+0000 7fee737fe640 1 -- 172.21.15.17:0/1776821785 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee740a1250 con 0x7fee740a1750 2024-04-17T02:22:30.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.908+0000 7fee737fe640 1 -- 172.21.15.17:0/1776821785 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1752030744 0 0) 0x7fee6c0019f0 con 0x7fee740a1750 2024-04-17T02:22:30.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.908+0000 7fee737fe640 1 -- 172.21.15.17:0/1776821785 >> v1:172.21.15.17:6789/0 conn(0x7fee740a1750 legacy=0x7fee7414d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:30.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.908+0000 7fee737fe640 1 --2- 172.21.15.17:0/1776821785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee600039b0 0x7fee60003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:30.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.908+0000 7fee737fe640 1 --2- 172.21.15.17:0/1776821785 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fee60004800 0x7fee60004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:30.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.908+0000 7fee737fe640 1 --2- 172.21.15.17:0/1776821785 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee600051c0 0x7fee6000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:30.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.908+0000 7fee737fe640 1 -- 172.21.15.17:0/1776821785 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fee740a0900 con 0x7fee600039b0 2024-04-17T02:22:30.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.908+0000 7fee737fe640 1 -- 172.21.15.17:0/1776821785 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fee6000c160 con 0x7fee600051c0 2024-04-17T02:22:30.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.908+0000 7fee737fe640 1 -- 172.21.15.17:0/1776821785 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fee6000c360 con 0x7fee60004800 2024-04-17T02:22:30.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.908+0000 7fee73fff640 1 --2- 172.21.15.17:0/1776821785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee600039b0 0x7fee60003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:30.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.908+0000 7fee6bfff640 1 --2- 172.21.15.17:0/1776821785 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fee60004800 0x7fee60004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:30.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.908+0000 7fee78c18640 1 --2- 172.21.15.17:0/1776821785 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee600051c0 0x7fee6000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:30.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.908+0000 7fee73fff640 1 -- 172.21.15.17:0/1776821785 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fee60004800 msgr2=0x7fee60004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:30.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.908+0000 7fee73fff640 1 --2- 172.21.15.17:0/1776821785 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fee60004800 0x7fee60004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:30.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.908+0000 7fee73fff640 1 -- 172.21.15.17:0/1776821785 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee600051c0 msgr2=0x7fee6000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:30.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.908+0000 7fee73fff640 1 --2- 172.21.15.17:0/1776821785 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee600051c0 0x7fee6000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:30.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.908+0000 7fee73fff640 1 -- 172.21.15.17:0/1776821785 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee60003520 con 0x7fee600039b0 2024-04-17T02:22:30.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.908+0000 7fee78c18640 1 -- 172.21.15.17:0/1776821785 reap_dead start 2024-04-17T02:22:30.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.909+0000 7fee73fff640 1 --2- 172.21.15.17:0/1776821785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee600039b0 0x7fee60003dd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fee64009ac0 tx=0x7fee60005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b33d4688aad10200 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:30.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.909+0000 7fee737fe640 1 -- 172.21.15.17:0/1776821785 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee64039070 con 0x7fee600039b0 2024-04-17T02:22:30.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.909+0000 7fee737fe640 1 -- 172.21.15.17:0/1776821785 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee6402c6b0 con 0x7fee600039b0 2024-04-17T02:22:30.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.909+0000 7fee737fe640 1 -- 172.21.15.17:0/1776821785 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee64009690 con 0x7fee600039b0 2024-04-17T02:22:30.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.909+0000 7fee7a67b640 1 -- 172.21.15.17:0/1776821785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee600039b0 msgr2=0x7fee60003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:30.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.909+0000 7fee7a67b640 1 --2- 172.21.15.17:0/1776821785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee600039b0 0x7fee60003dd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fee64009ac0 tx=0x7fee60005830 comp rx=0 tx=0).stop 2024-04-17T02:22:30.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.909+0000 7fee7a67b640 1 -- 172.21.15.17:0/1776821785 shutdown_connections 2024-04-17T02:22:30.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.909+0000 7fee7a67b640 1 --2- 172.21.15.17:0/1776821785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee600039b0 0x7fee60003dd0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:30.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.909+0000 7fee7a67b640 1 -- 172.21.15.17:0/1776821785 >> 172.21.15.17:0/1776821785 conn(0x7fee740748d0 msgr2=0x7fee740a59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:30.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.910+0000 7fee7a67b640 1 -- 172.21.15.17:0/1776821785 shutdown_connections 2024-04-17T02:22:30.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.910+0000 7fee7a67b640 1 -- 172.21.15.17:0/1776821785 wait complete. 2024-04-17T02:22:30.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.911+0000 7fee7a67b640 1 Processor -- start 2024-04-17T02:22:30.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.911+0000 7fee7a67b640 1 -- start start 2024-04-17T02:22:30.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.911+0000 7fee7a67b640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fee600039b0 0x7fee74070280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:30.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.911+0000 7fee7a67b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee740707c0 0x7fee74146670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:30.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.911+0000 7fee7a67b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee74146bb0 0x7fee741dbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:30.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.911+0000 7fee7a67b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fee740a1000 con 0x7fee740707c0 2024-04-17T02:22:30.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.911+0000 7fee7a67b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fee740a54c0 con 0x7fee74146bb0 2024-04-17T02:22:30.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.911+0000 7fee7a67b640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fee7406c730 con 0x7fee600039b0 2024-04-17T02:22:30.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.911+0000 7fee73fff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fee600039b0 0x7fee74070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:30.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.911+0000 7fee73fff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fee600039b0 0x7fee74070280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:52954/0 (socket says 172.21.15.17:52954) 2024-04-17T02:22:30.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.911+0000 7fee6bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee740707c0 0x7fee74146670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:30.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.911+0000 7fee73fff640 1 -- 172.21.15.17:0/2252370631 learned_addr learned my addr 172.21.15.17:0/2252370631 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:30.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.912+0000 7fee73fff640 1 -- 172.21.15.17:0/2252370631 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee74146bb0 msgr2=0x7fee741dbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:30.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.912+0000 7fee73fff640 1 --2- 172.21.15.17:0/2252370631 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee74146bb0 0x7fee741dbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:30.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.912+0000 7fee73fff640 1 -- 172.21.15.17:0/2252370631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee740707c0 msgr2=0x7fee74146670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:30.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.912+0000 7fee73fff640 1 --2- 172.21.15.17:0/2252370631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee740707c0 0x7fee74146670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:30.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.912+0000 7fee73fff640 1 -- 172.21.15.17:0/2252370631 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee741dcc60 con 0x7fee600039b0 2024-04-17T02:22:30.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.912+0000 7fee6bfff640 1 --2- 172.21.15.17:0/2252370631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee740707c0 0x7fee74146670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:30.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.912+0000 7fee73fff640 1 --2- 172.21.15.17:0/2252370631 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fee600039b0 0x7fee74070280 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fee64009be0 tx=0x7fee64004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:30.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.912+0000 7fee717fa640 1 -- 172.21.15.17:0/2252370631 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee64042020 con 0x7fee600039b0 2024-04-17T02:22:30.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.912+0000 7fee717fa640 1 -- 172.21.15.17:0/2252370631 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee6403a040 con 0x7fee600039b0 2024-04-17T02:22:30.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.912+0000 7fee7a67b640 1 -- 172.21.15.17:0/2252370631 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee741446b0 con 0x7fee600039b0 2024-04-17T02:22:30.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.912+0000 7fee717fa640 1 -- 172.21.15.17:0/2252370631 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee64039070 con 0x7fee600039b0 2024-04-17T02:22:30.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.912+0000 7fee7a67b640 1 -- 172.21.15.17:0/2252370631 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fee7413c280 con 0x7fee600039b0 2024-04-17T02:22:30.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.913+0000 7fee7a67b640 1 -- 172.21.15.17:0/2252370631 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee740a4040 con 0x7fee600039b0 2024-04-17T02:22:30.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.915+0000 7fee717fa640 1 -- 172.21.15.17:0/2252370631 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7fee64045020 con 0x7fee600039b0 2024-04-17T02:22:30.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.915+0000 7fee717fa640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:30.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.915+0000 7fee717fa640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:30.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.915+0000 7fee717fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:30.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.915+0000 7fee717fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:30.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.915+0000 7fee717fa640 1 --2- 172.21.15.17:0/2252370631 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fee5409f4b0 0x7fee540a1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:30.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.915+0000 7fee6bfff640 1 --2- 172.21.15.17:0/2252370631 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fee5409f4b0 0x7fee540a1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:30.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.915+0000 7fee717fa640 1 -- 172.21.15.17:0/2252370631 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7fee640eb380 con 0x7fee600039b0 2024-04-17T02:22:30.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.916+0000 7fee6bfff640 1 --2- 172.21.15.17:0/2252370631 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fee5409f4b0 0x7fee540a1970 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fee7409fd60 tx=0x7fee5c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:30.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:30.919+0000 7fee717fa640 1 -- 172.21.15.17:0/2252370631 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fee740a4040 con 0x7fee600039b0 2024-04-17T02:22:31.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.101+0000 7fee7a67b640 1 -- 172.21.15.17:0/2252370631 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fee740687f0 con 0x7fee600039b0 2024-04-17T02:22:31.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.102+0000 7fee717fa640 1 -- 172.21.15.17:0/2252370631 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+13561 (secure 0 0 0) 0x7fee6404c030 con 0x7fee600039b0 2024-04-17T02:22:31.103 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:22:31.103 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":20,"fsid":"7cbfae20-b10d-41da-92b7-cbd5c1632e23","created":"2024-04-17T02:22:00.246446+0000","modified":"2024-04-17T02:22:23.241120+0000","last_up_change":"2024-04-17T02:22:09.077928+0000","last_in_change":"2024-04-17T02:22:01.415384+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T02:22:10.533377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-17T02:22:15.947495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-17T02:22:20.016616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-17T02:22:20.573938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2973665c-6c5e-4688-bffe-72d3bdcf467f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6801","nonce":1828284343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6803","nonce":1828284343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6807","nonce":1828284343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6805","nonce":1828284343}]},"public_addr":"172.21.15.17:6801/1828284343","cluster_addr":"172.21.15.17:6803/1828284343","heartbeat_back_addr":"172.21.15.17:6807/1828284343","heartbeat_front_addr":"172.21.15.17:6805/1828284343","state":["exists","up"]},{"osd":1,"uuid":"a59a034d-19b4-47e8-8ca5-538597b4af1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6809","nonce":2064593011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6811","nonce":2064593011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6815","nonce":2064593011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6813","nonce":2064593011}]},"public_addr":"172.21.15.122:6809/2064593011","cluster_addr":"172.21.15.122:6811/2064593011","heartbeat_back_addr":"172.21.15.122:6815/2064593011","heartbeat_front_addr":"172.21.15.122:6813/2064593011","state":["exists","up"]},{"osd":2,"uuid":"070f4c5f-459f-46ff-b980-05b1ac50c951","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6817","nonce":929092547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6819","nonce":929092547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6823","nonce":929092547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6821","nonce":929092547}]},"public_addr":"172.21.15.122:6817/929092547","cluster_addr":"172.21.15.122:6819/929092547","heartbeat_back_addr":"172.21.15.122:6823/929092547","heartbeat_front_addr":"172.21.15.122:6821/929092547","state":["exists","up"]},{"osd":3,"uuid":"96216a49-a7b6-40eb-bc93-cc8c78a5270a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6801","nonce":204132523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6803","nonce":204132523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6807","nonce":204132523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6805","nonce":204132523}]},"public_addr":"172.21.15.122:6801/204132523","cluster_addr":"172.21.15.122:6803/204132523","heartbeat_back_addr":"172.21.15.122:6807/204132523","heartbeat_front_addr":"172.21.15.122:6805/204132523","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.477173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.522791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.590625+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.480698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T02:22:31.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.104+0000 7fee7a67b640 10 mgrc shutdown 2024-04-17T02:22:31.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.104+0000 7fee7a67b640 1 -- 172.21.15.17:0/2252370631 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fee5409f4b0 msgr2=0x7fee540a1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.104+0000 7fee7a67b640 1 --2- 172.21.15.17:0/2252370631 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fee5409f4b0 0x7fee540a1970 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fee7409fd60 tx=0x7fee5c009040 comp rx=0 tx=0).stop 2024-04-17T02:22:31.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.104+0000 7fee7a67b640 1 -- 172.21.15.17:0/2252370631 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fee600039b0 msgr2=0x7fee74070280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.104+0000 7fee7a67b640 1 --2- 172.21.15.17:0/2252370631 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fee600039b0 0x7fee74070280 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fee64009be0 tx=0x7fee64004730 comp rx=0 tx=0).stop 2024-04-17T02:22:31.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.104+0000 7fee7a67b640 1 -- 172.21.15.17:0/2252370631 shutdown_connections 2024-04-17T02:22:31.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.104+0000 7fee7a67b640 1 --2- 172.21.15.17:0/2252370631 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fee5409f4b0 0x7fee540a1970 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.104+0000 7fee7a67b640 1 --2- 172.21.15.17:0/2252370631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee740707c0 0x7fee74146670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.104+0000 7fee7a67b640 1 --2- 172.21.15.17:0/2252370631 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee74146bb0 0x7fee741dbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.104+0000 7fee7a67b640 1 --2- 172.21.15.17:0/2252370631 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fee600039b0 0x7fee74070280 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.104+0000 7fee7a67b640 1 -- 172.21.15.17:0/2252370631 >> 172.21.15.17:0/2252370631 conn(0x7fee740748d0 msgr2=0x7fee740a35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:31.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.104+0000 7fee7a67b640 1 -- 172.21.15.17:0/2252370631 shutdown_connections 2024-04-17T02:22:31.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.104+0000 7fee7a67b640 1 -- 172.21.15.17:0/2252370631 wait complete. 2024-04-17T02:22:31.116 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-17T02:22:31.116 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-17T02:22:31.117 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-17T02:22:31.117 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-17T02:22:31.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.227+0000 7f995c045640 1 Processor -- start 2024-04-17T02:22:31.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.227+0000 7f4af47ed640 1 Processor -- start 2024-04-17T02:22:31.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.227+0000 7f4af47ed640 1 -- start start 2024-04-17T02:22:31.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.227+0000 7f9ea68a1640 1 Processor -- start 2024-04-17T02:22:31.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.227+0000 7fb418a72640 1 Processor -- start 2024-04-17T02:22:31.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.227+0000 7f9ea68a1640 1 -- start start 2024-04-17T02:22:31.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.227+0000 7f995c045640 1 -- start start 2024-04-17T02:22:31.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.227+0000 7fb418a72640 1 -- start start 2024-04-17T02:22:31.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.228+0000 7f995c045640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f99540a0520 0x7f995406c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.228+0000 7f9ea68a1640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9ea0138170 0x7f9ea00a8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.228+0000 7fb418a72640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb4140ab5b0 0x7fb4140ac680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.228+0000 7f995c045640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f995406d5c0 0x7f9954143510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.228+0000 7f995c045640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f99540a1750 0x7f9954143a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.228+0000 7fb418a72640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb414142c90 0x7fb41414fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.228+0000 7f9ea68a1640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9ea006c450 0x7f9ea006c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.228+0000 7f9ea68a1640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ea0137a20 con 0x7f9ea0137570 2024-04-17T02:22:31.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.228+0000 7f9ea68a1640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f9ea0138550 con 0x7f9ea006c450 2024-04-17T02:22:31.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.228+0000 7f9ea68a1640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea013b7d0 con 0x7f9ea0138170 2024-04-17T02:22:31.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.228+0000 7fb418a72640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4140acea0 con 0x7fb4140bb460 2024-04-17T02:22:31.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.228+0000 7fb418a72640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fb4140ab990 con 0x7fb4140ab5b0 2024-04-17T02:22:31.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.228+0000 7fb418a72640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fb41406c330 con 0x7fb414142c90 2024-04-17T02:22:31.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.228+0000 7f995c045640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f99540a0900 con 0x7f99540a0520 2024-04-17T02:22:31.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.228+0000 7fb41259c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb4140ab5b0 0x7fb4140ac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.228+0000 7f995c045640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f99540a1000 con 0x7f995406d5c0 2024-04-17T02:22:31.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.228+0000 7f995c045640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f99540a1c60 con 0x7f99540a1750 2024-04-17T02:22:31.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.228+0000 7f9959de1640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f99540a0520 0x7f995406c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.228+0000 7f9ea4e3e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9ea006c450 0x7f9ea006c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.228+0000 7f4af47ed640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f4aec0a8000 0x7f4aec0a83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.228+0000 7f4af47ed640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4aec0a98a0 0x7f4aec145570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.228+0000 7f4af47ed640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4aec0a4940 con 0x7f4aec145ab0 2024-04-17T02:22:31.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.228+0000 7f4af47ed640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f4aec0a5900 con 0x7f4aec0a98a0 2024-04-17T02:22:31.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.228+0000 7f4af47ed640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f4aec145f40 con 0x7f4aec0a8000 2024-04-17T02:22:31.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.228+0000 7fb41259c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb4140ab5b0 0x7fb4140ac680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52294/0 (socket says 172.21.15.17:52294) 2024-04-17T02:22:31.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.228+0000 7f9959de1640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f99540a0520 0x7f995406c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52292/0 (socket says 172.21.15.17:52292) 2024-04-17T02:22:31.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.228+0000 7fb41259c640 1 -- 172.21.15.17:0/2212638312 learned_addr learned my addr 172.21.15.17:0/2212638312 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:31.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.228+0000 7f9959de1640 1 -- 172.21.15.17:0/1813420826 learned_addr learned my addr 172.21.15.17:0/1813420826 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:31.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.228+0000 7f99595e0640 1 --2- 172.21.15.17:0/1813420826 >> v2:172.21.15.122:3300/0 conn(0x7f995406d5c0 0x7f9954143510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.228+0000 7f9ea4e3e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9ea006c450 0x7f9ea006c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52314/0 (socket says 172.21.15.17:52314) 2024-04-17T02:22:31.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.228+0000 7f9ea4e3e640 1 -- 172.21.15.17:0/324445624 learned_addr learned my addr 172.21.15.17:0/324445624 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:31.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.228+0000 7f9e9ffff640 1 --2- 172.21.15.17:0/324445624 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9ea0138170 0x7f9ea00a8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.228+0000 7f4af2589640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f4aec0a8000 0x7f4aec0a83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.229+0000 7f4af2d8a640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f4aec145ab0 0x7f4aec0a5b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.17:32960/0 (socket says 172.21.15.17:32960) 2024-04-17T02:22:31.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.229+0000 7fb412d9d640 1 --2- 172.21.15.17:0/2212638312 >> v2:172.21.15.122:3300/0 conn(0x7fb414142c90 0x7fb41414fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.229+0000 7f4af2d8a640 1 -- 172.21.15.17:0/2591214796 learned_addr learned my addr 172.21.15.17:0/2591214796 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:22:31.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.229+0000 7f4af1d88640 1 --2- 172.21.15.17:0/2591214796 >> v2:172.21.15.122:3300/0 conn(0x7f4aec0a98a0 0x7f4aec145570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.229+0000 7f995a5e2640 1 --2- 172.21.15.17:0/1813420826 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f99540a1750 0x7f9954143a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.229+0000 7f9ea4e3e640 1 -- 172.21.15.17:0/324445624 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9ea0138170 msgr2=0x7f9ea00a8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:31.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.229+0000 7f99595e0640 1 -- 172.21.15.17:0/1813420826 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f99540a1750 msgr2=0x7f9954143a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:31.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.229+0000 7f99595e0640 1 --2- 172.21.15.17:0/1813420826 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f99540a1750 0x7f9954143a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.229+0000 7f99595e0640 1 -- 172.21.15.17:0/1813420826 >> v2:172.21.15.17:3300/0 conn(0x7f99540a0520 msgr2=0x7f995406c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:31.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.229+0000 7f99595e0640 1 --2- 172.21.15.17:0/1813420826 >> v2:172.21.15.17:3300/0 conn(0x7f99540a0520 0x7f995406c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.229+0000 7f99595e0640 1 -- 172.21.15.17:0/1813420826 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99540a1f20 con 0x7f995406d5c0 2024-04-17T02:22:31.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.229+0000 7f9959de1640 1 --2- 172.21.15.17:0/1813420826 >> v2:172.21.15.17:3300/0 conn(0x7f99540a0520 0x7f995406c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:31.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.229+0000 7f9ea4e3e640 1 --2- 172.21.15.17:0/324445624 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9ea0138170 0x7f9ea00a8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.229+0000 7f9ea4e3e640 1 -- 172.21.15.17:0/324445624 >> v1:172.21.15.122:6789/0 conn(0x7f9ea0137570 legacy=0x7f9ea00a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.229+0000 7f9ea4e3e640 1 -- 172.21.15.17:0/324445624 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea0137ce0 con 0x7f9ea006c450 2024-04-17T02:22:31.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.229+0000 7f4af1587640 1 -- 172.21.15.17:0/2591214796 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3582129532 0 0) 0x7f4ae4001490 con 0x7f4aec145ab0 2024-04-17T02:22:31.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.229+0000 7f4af2589640 1 -- 172.21.15.17:0/2591214796 >> v2:172.21.15.122:3300/0 conn(0x7f4aec0a98a0 msgr2=0x7f4aec145570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:31.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.229+0000 7f4af2589640 1 --2- 172.21.15.17:0/2591214796 >> v2:172.21.15.122:3300/0 conn(0x7f4aec0a98a0 0x7f4aec145570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.229+0000 7f4af2589640 1 -- 172.21.15.17:0/2591214796 >> v1:172.21.15.122:6789/0 conn(0x7f4aec145ab0 legacy=0x7f4aec0a5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.229+0000 7f4af2589640 1 -- 172.21.15.17:0/2591214796 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aec0a9c80 con 0x7f4aec0a8000 2024-04-17T02:22:31.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.229+0000 7fb412d9d640 1 -- 172.21.15.17:0/2212638312 >> v2:172.21.15.17:3300/0 conn(0x7fb4140ab5b0 msgr2=0x7fb4140ac680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:31.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.229+0000 7fb412d9d640 1 --2- 172.21.15.17:0/2212638312 >> v2:172.21.15.17:3300/0 conn(0x7fb4140ab5b0 0x7fb4140ac680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.229+0000 7fb412d9d640 1 -- 172.21.15.17:0/2212638312 >> v1:172.21.15.122:6789/0 conn(0x7fb4140bb460 legacy=0x7fb414142580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.229+0000 7fb412d9d640 1 -- 172.21.15.17:0/2212638312 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4140acbc0 con 0x7fb414142c90 2024-04-17T02:22:31.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.230+0000 7f9ea4e3e640 1 --2- 172.21.15.17:0/324445624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ea006c450 0x7f9ea006c900 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9e9800b1a0 tx=0x7f9e9802c1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e62de11103728028 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:31.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.230+0000 7f99595e0640 1 --2- 172.21.15.17:0/1813420826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f995406d5c0 0x7f9954143510 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f99540a6a80 tx=0x7f994802b7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d18c52dd60fab3f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:31.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.230+0000 7f4af2589640 1 --2- 172.21.15.17:0/2591214796 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f4aec0a8000 0x7f4aec0a83e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4ae80097a0 tx=0x7f4ae802b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b54f9a17a4df5876 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:31.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.230+0000 7fb412d9d640 1 --2- 172.21.15.17:0/2212638312 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb414142c90 0x7fb41414fa90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb4140abdb0 tx=0x7fb40c02bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed5fd13d25c87841 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:31.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.230+0000 7f9e9effd640 1 -- 172.21.15.17:0/324445624 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9802cb50 con 0x7f9ea006c450 2024-04-17T02:22:31.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.230+0000 7f9e9effd640 1 -- 172.21.15.17:0/324445624 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e9802ccf0 con 0x7f9ea006c450 2024-04-17T02:22:31.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.230+0000 7f9958ddf640 1 -- 172.21.15.17:0/1813420826 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9948038070 con 0x7f995406d5c0 2024-04-17T02:22:31.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.230+0000 7f9958ddf640 1 -- 172.21.15.17:0/1813420826 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9948031710 con 0x7f995406d5c0 2024-04-17T02:22:31.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.230+0000 7f9e9effd640 1 -- 172.21.15.17:0/324445624 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e98034610 con 0x7f9ea006c450 2024-04-17T02:22:31.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.230+0000 7f9958ddf640 1 -- 172.21.15.17:0/1813420826 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9948031ae0 con 0x7f995406d5c0 2024-04-17T02:22:31.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.230+0000 7f4af1587640 1 -- 172.21.15.17:0/2591214796 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8031780 con 0x7f4aec0a8000 2024-04-17T02:22:31.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.230+0000 7f4af1587640 1 -- 172.21.15.17:0/2591214796 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae8037070 con 0x7f4aec0a8000 2024-04-17T02:22:31.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.230+0000 7f4af1587640 1 -- 172.21.15.17:0/2591214796 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8031b40 con 0x7f4aec0a8000 2024-04-17T02:22:31.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.230+0000 7fb411d9b640 1 -- 172.21.15.17:0/2212638312 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb40c039070 con 0x7fb414142c90 2024-04-17T02:22:31.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.230+0000 7fb411d9b640 1 -- 172.21.15.17:0/2212638312 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb40c02cc80 con 0x7fb414142c90 2024-04-17T02:22:31.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.230+0000 7fb411d9b640 1 -- 172.21.15.17:0/2212638312 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb40c039070 con 0x7fb414142c90 2024-04-17T02:22:31.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.231+0000 7f4af47ed640 1 -- 172.21.15.17:0/2591214796 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f4aec0a8000 msgr2=0x7f4aec0a83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.231+0000 7f4af47ed640 1 --2- 172.21.15.17:0/2591214796 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f4aec0a8000 0x7f4aec0a83e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4ae80097a0 tx=0x7f4ae802b820 comp rx=0 tx=0).stop 2024-04-17T02:22:31.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.231+0000 7f9ea68a1640 1 -- 172.21.15.17:0/324445624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ea006c450 msgr2=0x7f9ea006c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.231+0000 7f9ea68a1640 1 --2- 172.21.15.17:0/324445624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ea006c450 0x7f9ea006c900 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9e9800b1a0 tx=0x7f9e9802c1b0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.231+0000 7f995c045640 1 -- 172.21.15.17:0/1813420826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f995406d5c0 msgr2=0x7f9954143510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.231+0000 7f4af47ed640 1 -- 172.21.15.17:0/2591214796 shutdown_connections 2024-04-17T02:22:31.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.231+0000 7f995c045640 1 --2- 172.21.15.17:0/1813420826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f995406d5c0 0x7f9954143510 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f99540a6a80 tx=0x7f994802b7b0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.231+0000 7f4af47ed640 1 --2- 172.21.15.17:0/2591214796 >> v2:172.21.15.122:3300/0 conn(0x7f4aec0a98a0 0x7f4aec145570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.231+0000 7f9ea68a1640 1 -- 172.21.15.17:0/324445624 shutdown_connections 2024-04-17T02:22:31.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.231+0000 7f4af47ed640 1 --2- 172.21.15.17:0/2591214796 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f4aec0a8000 0x7f4aec0a83e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.231+0000 7f9ea68a1640 1 --2- 172.21.15.17:0/324445624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ea006c450 0x7f9ea006c900 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.231+0000 7f9ea68a1640 1 --2- 172.21.15.17:0/324445624 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9ea0138170 0x7f9ea00a8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.231+0000 7f9ea68a1640 1 -- 172.21.15.17:0/324445624 >> 172.21.15.17:0/324445624 conn(0x7f9ea00748d0 msgr2=0x7f9ea00a59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:31.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.231+0000 7fb418a72640 1 -- 172.21.15.17:0/2212638312 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb414142c90 msgr2=0x7fb41414fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.231+0000 7fb418a72640 1 --2- 172.21.15.17:0/2212638312 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb414142c90 0x7fb41414fa90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb4140abdb0 tx=0x7fb40c02bed0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.231+0000 7f4af47ed640 1 -- 172.21.15.17:0/2591214796 >> 172.21.15.17:0/2591214796 conn(0x7f4aec0a6ab0 msgr2=0x7f4aec0a6ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:31.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.231+0000 7f9ea68a1640 1 -- 172.21.15.17:0/324445624 shutdown_connections 2024-04-17T02:22:31.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.231+0000 7f995c045640 1 -- 172.21.15.17:0/1813420826 shutdown_connections 2024-04-17T02:22:31.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.231+0000 7f995c045640 1 --2- 172.21.15.17:0/1813420826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f995406d5c0 0x7f9954143510 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.231+0000 7f995c045640 1 --2- 172.21.15.17:0/1813420826 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f99540a1750 0x7f9954143a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.231+0000 7f995c045640 1 --2- 172.21.15.17:0/1813420826 >> v2:172.21.15.17:3300/0 conn(0x7f99540a0520 0x7f995406c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.231+0000 7f995c045640 1 -- 172.21.15.17:0/1813420826 >> 172.21.15.17:0/1813420826 conn(0x7f99540748d0 msgr2=0x7f99540a59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:31.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.231+0000 7f9ea68a1640 1 -- 172.21.15.17:0/324445624 wait complete. 2024-04-17T02:22:31.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.231+0000 7f4af47ed640 1 -- 172.21.15.17:0/2591214796 shutdown_connections 2024-04-17T02:22:31.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.231+0000 7fb418a72640 1 -- 172.21.15.17:0/2212638312 shutdown_connections 2024-04-17T02:22:31.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.231+0000 7fb418a72640 1 --2- 172.21.15.17:0/2212638312 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb414142c90 0x7fb41414fa90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.231+0000 7fb418a72640 1 --2- 172.21.15.17:0/2212638312 >> v2:172.21.15.17:3300/0 conn(0x7fb4140ab5b0 0x7fb4140ac680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.231+0000 7f995c045640 1 -- 172.21.15.17:0/1813420826 shutdown_connections 2024-04-17T02:22:31.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.231+0000 7fb418a72640 1 -- 172.21.15.17:0/2212638312 >> 172.21.15.17:0/2212638312 conn(0x7fb4140ba940 msgr2=0x7fb4140bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:31.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.231+0000 7f995c045640 1 -- 172.21.15.17:0/1813420826 wait complete. 2024-04-17T02:22:31.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.231+0000 7f4af47ed640 1 -- 172.21.15.17:0/2591214796 wait complete. 2024-04-17T02:22:31.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.231+0000 7fb418a72640 1 -- 172.21.15.17:0/2212638312 shutdown_connections 2024-04-17T02:22:31.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.232+0000 7fb418a72640 1 -- 172.21.15.17:0/2212638312 wait complete. 2024-04-17T02:22:31.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.232+0000 7f995c045640 1 Processor -- start 2024-04-17T02:22:31.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.232+0000 7f995c045640 1 -- start start 2024-04-17T02:22:31.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.232+0000 7f4af47ed640 1 Processor -- start 2024-04-17T02:22:31.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.233+0000 7f4af47ed640 1 -- start start 2024-04-17T02:22:31.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.233+0000 7f9ea68a1640 1 Processor -- start 2024-04-17T02:22:31.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.233+0000 7f9ea68a1640 1 -- start start 2024-04-17T02:22:31.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.233+0000 7f995c045640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f995406d5c0 0x7f9954072340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.233+0000 7f995c045640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99540a0520 0x7f99541de8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.233+0000 7f995c045640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f99540a1750 0x7f99541dedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.233+0000 7f995c045640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f99540a52b0 con 0x7f99540a0520 2024-04-17T02:22:31.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.233+0000 7f995c045640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f995406ccb0 con 0x7f995406d5c0 2024-04-17T02:22:31.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.233+0000 7f995c045640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f99540a5430 con 0x7f99540a1750 2024-04-17T02:22:31.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.233+0000 7f4af47ed640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f4aec0a8000 0x7f4aec099cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.233+0000 7f995a5e2640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f99540a1750 0x7f99541dedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.233+0000 7f99595e0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99540a0520 0x7f99541de8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.233+0000 7f4af47ed640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4aec0a98a0 0x7f4aec13b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.233+0000 7f995a5e2640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f99540a1750 0x7f99541dedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:52980/0 (socket says 172.21.15.17:52980) 2024-04-17T02:22:31.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.233+0000 7f995a5e2640 1 -- 172.21.15.17:0/1593874074 learned_addr learned my addr 172.21.15.17:0/1593874074 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:31.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.233+0000 7f4af47ed640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4aec13bb50 0x7f4aec0a2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.233+0000 7f4af47ed640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec0a63c0 con 0x7f4aec13bb50 2024-04-17T02:22:31.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.233+0000 7f4af47ed640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec0a6240 con 0x7f4aec0a98a0 2024-04-17T02:22:31.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.233+0000 7f4af47ed640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f4aec0a6540 con 0x7f4aec0a8000 2024-04-17T02:22:31.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.233+0000 7f4af2589640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f4aec0a8000 0x7f4aec099cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.233+0000 7f9959de1640 1 --2- 172.21.15.17:0/1593874074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f995406d5c0 0x7f9954072340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.233+0000 7f4af2589640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f4aec0a8000 0x7f4aec099cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:52982/0 (socket says 172.21.15.17:52982) 2024-04-17T02:22:31.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.233+0000 7f4af2589640 1 -- 172.21.15.17:0/3213620709 learned_addr learned my addr 172.21.15.17:0/3213620709 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:31.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.233+0000 7f4af2d8a640 1 --2- 172.21.15.17:0/3213620709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4aec13bb50 0x7f4aec0a2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.234+0000 7fb418a72640 1 Processor -- start 2024-04-17T02:22:31.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.234+0000 7f99595e0640 1 -- 172.21.15.17:0/1593874074 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f99540a1750 msgr2=0x7f99541dedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.234+0000 7f4af2589640 1 -- 172.21.15.17:0/3213620709 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4aec0a98a0 msgr2=0x7f4aec13b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.234+0000 7f99595e0640 1 --2- 172.21.15.17:0/1593874074 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f99540a1750 0x7f99541dedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.234+0000 7f4af2589640 1 --2- 172.21.15.17:0/3213620709 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4aec0a98a0 0x7f4aec13b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.234+0000 7f99595e0640 1 -- 172.21.15.17:0/1593874074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f995406d5c0 msgr2=0x7f9954072340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.234+0000 7f99595e0640 1 --2- 172.21.15.17:0/1593874074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f995406d5c0 0x7f9954072340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.234+0000 7f4af2589640 1 -- 172.21.15.17:0/3213620709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4aec13bb50 msgr2=0x7f4aec0a2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.234+0000 7f4af2589640 1 --2- 172.21.15.17:0/3213620709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4aec13bb50 0x7f4aec0a2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.234+0000 7f99595e0640 1 -- 172.21.15.17:0/1593874074 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f995406fa60 con 0x7f99540a0520 2024-04-17T02:22:31.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.234+0000 7f4af2589640 1 -- 172.21.15.17:0/3213620709 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aec0a3b60 con 0x7f4aec0a8000 2024-04-17T02:22:31.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.234+0000 7fb418a72640 1 -- start start 2024-04-17T02:22:31.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.234+0000 7f995a5e2640 1 --2- 172.21.15.17:0/1593874074 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f99540a1750 0x7f99541dedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T02:22:31.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.234+0000 7f4af2589640 1 --2- 172.21.15.17:0/3213620709 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f4aec0a8000 0x7f4aec099cb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4ae80098c0 tx=0x7f4ae80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:31.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.234+0000 7f99595e0640 1 --2- 172.21.15.17:0/1593874074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99540a0520 0x7f99541de8b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f99540a1180 tx=0x7f99480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:31.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.234+0000 7f4ae2ffd640 1 -- 172.21.15.17:0/3213620709 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8032620 con 0x7f4aec0a8000 2024-04-17T02:22:31.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.234+0000 7f99527fc640 1 -- 172.21.15.17:0/1593874074 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9948038040 con 0x7f99540a0520 2024-04-17T02:22:31.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.234+0000 7f4ae2ffd640 1 -- 172.21.15.17:0/3213620709 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae80327e0 con 0x7f4aec0a8000 2024-04-17T02:22:31.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.234+0000 7f4ae2ffd640 1 -- 172.21.15.17:0/3213620709 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8032bd0 con 0x7f4aec0a8000 2024-04-17T02:22:31.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.234+0000 7f4af47ed640 1 -- 172.21.15.17:0/3213620709 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aec13c200 con 0x7f4aec0a8000 2024-04-17T02:22:31.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.234+0000 7f99527fc640 1 -- 172.21.15.17:0/1593874074 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f994803c610 con 0x7f99540a0520 2024-04-17T02:22:31.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.234+0000 7f4af47ed640 1 -- 172.21.15.17:0/3213620709 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aec09a1f0 con 0x7f4aec0a8000 2024-04-17T02:22:31.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.234+0000 7f995c045640 1 -- 172.21.15.17:0/1593874074 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f995406fce0 con 0x7f99540a0520 2024-04-17T02:22:31.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.234+0000 7f99527fc640 1 -- 172.21.15.17:0/1593874074 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994803ca00 con 0x7f99540a0520 2024-04-17T02:22:31.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.235+0000 7fb418a72640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb4140ab5b0 0x7fb4140b9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.235+0000 7fb41259c640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb4140ab5b0 0x7fb4140b9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.235+0000 7fb41259c640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb4140ab5b0 0x7fb4140b9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:52994/0 (socket says 172.21.15.17:52994) 2024-04-17T02:22:31.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.235+0000 7fb41259c640 1 -- 172.21.15.17:0/2423701179 learned_addr learned my addr 172.21.15.17:0/2423701179 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:31.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.235+0000 7fb418a72640 1 --2- 172.21.15.17:0/2423701179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4140bb460 0x7fb41413c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.235+0000 7fb418a72640 1 --2- 172.21.15.17:0/2423701179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb414142c90 0x7fb414148b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.235+0000 7f995c045640 1 -- 172.21.15.17:0/1593874074 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9954071bb0 con 0x7f99540a0520 2024-04-17T02:22:31.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.236+0000 7fb418a72640 1 -- 172.21.15.17:0/2423701179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb4140a9700 con 0x7fb414142c90 2024-04-17T02:22:31.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.236+0000 7fb412d9d640 1 --2- 172.21.15.17:0/2423701179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb414142c90 0x7fb414148b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.236+0000 7f995c045640 1 -- 172.21.15.17:0/1593874074 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f99540a8d20 con 0x7f99540a0520 2024-04-17T02:22:31.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.236+0000 7fb40bfff640 1 --2- 172.21.15.17:0/2423701179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4140bb460 0x7fb41413c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.236+0000 7fb418a72640 1 -- 172.21.15.17:0/2423701179 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb4140a7400 con 0x7fb4140bb460 2024-04-17T02:22:31.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.236+0000 7f9ea68a1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ea006c450 0x7f9ea00b0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.236+0000 7fb418a72640 1 -- 172.21.15.17:0/2423701179 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fb4140a9880 con 0x7fb4140ab5b0 2024-04-17T02:22:31.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.236+0000 7f4af47ed640 1 -- 172.21.15.17:0/3213620709 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4aec0687f0 con 0x7f4aec0a8000 2024-04-17T02:22:31.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.236+0000 7f9ea68a1640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9ea0137570 0x7f9ea0143ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.236+0000 7f9ea68a1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ea0138170 0x7f9ea0148ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.236+0000 7f9ea68a1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea014f800 con 0x7f9ea006c450 2024-04-17T02:22:31.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.236+0000 7f9ea68a1640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea00a7690 con 0x7f9ea0138170 2024-04-17T02:22:31.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.236+0000 7f9ea68a1640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea014f980 con 0x7f9ea0137570 2024-04-17T02:22:31.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.236+0000 7f9e9f7fe640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9ea0137570 0x7f9ea0143ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.236+0000 7f9e9f7fe640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9ea0137570 0x7f9ea0143ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:53000/0 (socket says 172.21.15.17:53000) 2024-04-17T02:22:31.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.236+0000 7f9e9f7fe640 1 -- 172.21.15.17:0/3605225829 learned_addr learned my addr 172.21.15.17:0/3605225829 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:31.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.236+0000 7f9e9ffff640 1 --2- 172.21.15.17:0/3605225829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ea006c450 0x7f9ea00b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.236+0000 7f9ea4e3e640 1 --2- 172.21.15.17:0/3605225829 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ea0138170 0x7f9ea0148ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.237+0000 7f9e9f7fe640 1 -- 172.21.15.17:0/3605225829 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ea0138170 msgr2=0x7f9ea0148ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.237+0000 7f9e9f7fe640 1 --2- 172.21.15.17:0/3605225829 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ea0138170 0x7f9ea0148ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.237+0000 7f9e9f7fe640 1 -- 172.21.15.17:0/3605225829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ea006c450 msgr2=0x7f9ea00b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.237+0000 7f9e9f7fe640 1 --2- 172.21.15.17:0/3605225829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ea006c450 0x7f9ea00b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.237+0000 7f9e9f7fe640 1 -- 172.21.15.17:0/3605225829 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea01482b0 con 0x7f9ea0137570 2024-04-17T02:22:31.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.237+0000 7fb412d9d640 1 -- 172.21.15.17:0/2423701179 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb4140ab5b0 msgr2=0x7fb4140b9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.237+0000 7fb412d9d640 1 --2- 172.21.15.17:0/2423701179 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb4140ab5b0 0x7fb4140b9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.237+0000 7fb412d9d640 1 -- 172.21.15.17:0/2423701179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4140bb460 msgr2=0x7fb41413c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.237+0000 7fb412d9d640 1 --2- 172.21.15.17:0/2423701179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4140bb460 0x7fb41413c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.237+0000 7fb412d9d640 1 -- 172.21.15.17:0/2423701179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb41413d050 con 0x7fb414142c90 2024-04-17T02:22:31.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.237+0000 7f9e9f7fe640 1 --2- 172.21.15.17:0/3605225829 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9ea0137570 0x7f9ea0143ee0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9e9400c450 tx=0x7f9e9400c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:31.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.237+0000 7fb412d9d640 1 --2- 172.21.15.17:0/2423701179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb414142c90 0x7fb414148b20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb40c033000 tx=0x7fb40c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:31.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.237+0000 7f9e9cff9640 1 -- 172.21.15.17:0/3605225829 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e940052d0 con 0x7f9ea0137570 2024-04-17T02:22:31.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.237+0000 7f9e9cff9640 1 -- 172.21.15.17:0/3605225829 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e94005470 con 0x7f9ea0137570 2024-04-17T02:22:31.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.237+0000 7f9e9cff9640 1 -- 172.21.15.17:0/3605225829 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e94012870 con 0x7f9ea0137570 2024-04-17T02:22:31.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.237+0000 7f9ea68a1640 1 -- 172.21.15.17:0/3605225829 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ea0148570 con 0x7f9ea0137570 2024-04-17T02:22:31.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.238+0000 7f99527fc640 1 -- 172.21.15.17:0/1593874074 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f9948045020 con 0x7f99540a0520 2024-04-17T02:22:31.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.238+0000 7f99527fc640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:31.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.238+0000 7f4ae2ffd640 1 -- 172.21.15.17:0/3213620709 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f4ae804c060 con 0x7f4aec0a8000 2024-04-17T02:22:31.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.238+0000 7f4ae2ffd640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:31.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.238+0000 7f9ea68a1640 1 -- 172.21.15.17:0/3605225829 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ea01436d0 con 0x7f9ea0137570 2024-04-17T02:22:31.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.238+0000 7fb40affd640 1 -- 172.21.15.17:0/2423701179 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb40c044020 con 0x7fb414142c90 2024-04-17T02:22:31.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.238+0000 7fb40affd640 1 -- 172.21.15.17:0/2423701179 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb40c040660 con 0x7fb414142c90 2024-04-17T02:22:31.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.238+0000 7fb40affd640 1 -- 172.21.15.17:0/2423701179 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb40c044020 con 0x7fb414142c90 2024-04-17T02:22:31.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.238+0000 7fb418a72640 1 -- 172.21.15.17:0/2423701179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb41413d310 con 0x7fb414142c90 2024-04-17T02:22:31.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.238+0000 7fb418a72640 1 -- 172.21.15.17:0/2423701179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4141d0ef0 con 0x7fb414142c90 2024-04-17T02:22:31.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.239+0000 7f99527fc640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:31.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.239+0000 7f9ea68a1640 1 -- 172.21.15.17:0/3605225829 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9ea00687f0 con 0x7f9ea0137570 2024-04-17T02:22:31.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.239+0000 7f99527fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:31.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.239+0000 7f99527fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:31.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.239+0000 7f99527fc640 1 --2- 172.21.15.17:0/1593874074 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f994009f480 0x7f99400a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.239+0000 7f9959de1640 1 --2- 172.21.15.17:0/1593874074 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f994009f480 0x7f99400a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.239+0000 7f99527fc640 1 -- 172.21.15.17:0/1593874074 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f99480eb080 con 0x7f99540a0520 2024-04-17T02:22:31.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.239+0000 7f99527fc640 1 --2- 172.21.15.17:0/1593874074 >> [v2:172.21.15.17:6800/1828284343,v1:172.21.15.17:6801/1828284343] conn(0x7f99400a6fe0 0x7f99400a9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.239+0000 7f99527fc640 1 -- 172.21.15.17:0/1593874074 --> [v2:172.21.15.17:6800/1828284343,v1:172.21.15.17:6801/1828284343] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9948031710 con 0x7f99400a6fe0 2024-04-17T02:22:31.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.239+0000 7f99527fc640 1 -- 172.21.15.17:0/1593874074 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f99480eb510 con 0x7f99540a0520 2024-04-17T02:22:31.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.239+0000 7f4ae2ffd640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:31.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.239+0000 7f4ae2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:31.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.239+0000 7f4ae2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:31.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.239+0000 7f4ae2ffd640 1 --2- 172.21.15.17:0/3213620709 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f4ad009f480 0x7f4ad00a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.239+0000 7f4ae2ffd640 1 -- 172.21.15.17:0/3213620709 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f4ae80eaa50 con 0x7f4aec0a8000 2024-04-17T02:22:31.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.239+0000 7f4ae2ffd640 1 --2- 172.21.15.17:0/3213620709 >> [v2:172.21.15.122:6816/929092547,v1:172.21.15.122:6817/929092547] conn(0x7f4ad00a6fe0 0x7f4ad00a9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.239+0000 7f4ae2ffd640 1 -- 172.21.15.17:0/3213620709 --> [v2:172.21.15.122:6816/929092547,v1:172.21.15.122:6817/929092547] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4ae8001d30 con 0x7f4ad00a6fe0 2024-04-17T02:22:31.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.239+0000 7f4ae2ffd640 1 -- 172.21.15.17:0/3213620709 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4ae80ef2c0 con 0x7f4aec0a8000 2024-04-17T02:22:31.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.239+0000 7f4af1d88640 1 --2- 172.21.15.17:0/3213620709 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f4ad009f480 0x7f4ad00a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.239+0000 7f995a5e2640 1 --2- 172.21.15.17:0/1593874074 >> [v2:172.21.15.17:6800/1828284343,v1:172.21.15.17:6801/1828284343] conn(0x7f99400a6fe0 0x7f99400a9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.240+0000 7f4af2d8a640 1 --2- 172.21.15.17:0/3213620709 >> [v2:172.21.15.122:6816/929092547,v1:172.21.15.122:6817/929092547] conn(0x7f4ad00a6fe0 0x7f4ad00a9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.240+0000 7fb418a72640 1 -- 172.21.15.17:0/2423701179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb4140687f0 con 0x7fb414142c90 2024-04-17T02:22:31.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.240+0000 7f995a5e2640 1 --2- 172.21.15.17:0/1593874074 >> [v2:172.21.15.17:6800/1828284343,v1:172.21.15.17:6801/1828284343] conn(0x7f99400a6fe0 0x7f99400a9420 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:31.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.240+0000 7f4af1d88640 1 --2- 172.21.15.17:0/3213620709 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f4ad009f480 0x7f4ad00a1940 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4adc006a90 tx=0x7f4adc006a20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:31.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.240+0000 7f4af2d8a640 1 --2- 172.21.15.17:0/3213620709 >> [v2:172.21.15.122:6816/929092547,v1:172.21.15.122:6817/929092547] conn(0x7f4ad00a6fe0 0x7f4ad00a9420 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:31.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.240+0000 7f9e9cff9640 1 -- 172.21.15.17:0/3605225829 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f9e94012a10 con 0x7f9ea0137570 2024-04-17T02:22:31.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.240+0000 7f9e9cff9640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:31.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.241+0000 7f99527fc640 1 -- 172.21.15.17:0/1593874074 <== osd.0 v2:172.21.15.17:6800/1828284343 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9948031710 con 0x7f99400a6fe0 2024-04-17T02:22:31.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.241+0000 7f4ae2ffd640 1 -- 172.21.15.17:0/3213620709 <== osd.2 v2:172.21.15.122:6816/929092547 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4ae8001d30 con 0x7f4ad00a6fe0 2024-04-17T02:22:31.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.241+0000 7f9e9cff9640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:31.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.241+0000 7f9e9cff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:31.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.241+0000 7f9e9cff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:31.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.241+0000 7f9e9cff9640 1 --2- 172.21.15.17:0/3605225829 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f9e8c09f480 0x7f9e8c0a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.242+0000 7f9e9cff9640 1 -- 172.21.15.17:0/3605225829 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f9e940c9a30 con 0x7f9ea0137570 2024-04-17T02:22:31.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.242+0000 7f9e9cff9640 1 --2- 172.21.15.17:0/3605225829 >> [v2:172.21.15.122:6808/2064593011,v1:172.21.15.122:6809/2064593011] conn(0x7f9e8c0a6fe0 0x7f9e8c0a9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.242+0000 7f9e9cff9640 1 -- 172.21.15.17:0/3605225829 --> [v2:172.21.15.122:6808/2064593011,v1:172.21.15.122:6809/2064593011] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9e94003e50 con 0x7f9e8c0a6fe0 2024-04-17T02:22:31.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.242+0000 7f9e9cff9640 1 -- 172.21.15.17:0/3605225829 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f9e940c9ec0 con 0x7f9ea0137570 2024-04-17T02:22:31.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.242+0000 7fb40affd640 1 -- 172.21.15.17:0/2423701179 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7fb40c047020 con 0x7fb414142c90 2024-04-17T02:22:31.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.242+0000 7fb40affd640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:31.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.242+0000 7f9ea4e3e640 1 --2- 172.21.15.17:0/3605225829 >> [v2:172.21.15.122:6808/2064593011,v1:172.21.15.122:6809/2064593011] conn(0x7f9e8c0a6fe0 0x7f9e8c0a9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.242+0000 7f9ea4e3e640 1 --2- 172.21.15.17:0/3605225829 >> [v2:172.21.15.122:6808/2064593011,v1:172.21.15.122:6809/2064593011] conn(0x7f9e8c0a6fe0 0x7f9e8c0a9420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:31.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.243+0000 7fb40affd640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:31.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.243+0000 7fb40affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:31.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.243+0000 7fb40affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:31.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.243+0000 7fb40affd640 1 --2- 172.21.15.17:0/2423701179 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fb3f409f800 0x7fb3f40a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.243+0000 7fb40affd640 1 -- 172.21.15.17:0/2423701179 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7fb40c02ca80 con 0x7fb414142c90 2024-04-17T02:22:31.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.243+0000 7fb40affd640 1 --2- 172.21.15.17:0/2423701179 >> [v2:172.21.15.122:6800/204132523,v1:172.21.15.122:6801/204132523] conn(0x7fb3f40a7360 0x7fb3f40a97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.243+0000 7fb40affd640 1 -- 172.21.15.17:0/2423701179 --> [v2:172.21.15.122:6800/204132523,v1:172.21.15.122:6801/204132523] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb40c02cc80 con 0x7fb3f40a7360 2024-04-17T02:22:31.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.243+0000 7fb40affd640 1 -- 172.21.15.17:0/2423701179 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb40c0ec1f0 con 0x7fb414142c90 2024-04-17T02:22:31.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.243+0000 7f9e9cff9640 1 -- 172.21.15.17:0/3605225829 <== osd.1 v2:172.21.15.122:6808/2064593011 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9e94003e50 con 0x7f9e8c0a6fe0 2024-04-17T02:22:31.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.243+0000 7fb40bfff640 1 --2- 172.21.15.17:0/2423701179 >> [v2:172.21.15.122:6800/204132523,v1:172.21.15.122:6801/204132523] conn(0x7fb3f40a7360 0x7fb3f40a97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.244+0000 7fb40bfff640 1 --2- 172.21.15.17:0/2423701179 >> [v2:172.21.15.122:6800/204132523,v1:172.21.15.122:6801/204132523] conn(0x7fb3f40a7360 0x7fb3f40a97a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:31.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.245+0000 7fb40affd640 1 -- 172.21.15.17:0/2423701179 <== osd.3 v2:172.21.15.122:6800/204132523 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb40c02cc80 con 0x7fb3f40a7360 2024-04-17T02:22:31.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.250+0000 7f9e9ffff640 1 --2- 172.21.15.17:0/3605225829 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f9e8c09f480 0x7f9e8c0a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.250+0000 7fb41259c640 1 --2- 172.21.15.17:0/2423701179 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fb3f409f800 0x7fb3f40a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.250+0000 7f9959de1640 1 --2- 172.21.15.17:0/1593874074 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f994009f480 0x7f99400a1940 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9944009630 tx=0x7f9944008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:31.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.250+0000 7f9e9ffff640 1 --2- 172.21.15.17:0/3605225829 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f9e8c09f480 0x7f9e8c0a1940 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9e90009aa0 tx=0x7f9e90009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:31.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.250+0000 7fb41259c640 1 --2- 172.21.15.17:0/2423701179 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fb3f409f800 0x7fb3f40a1cc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb4040094a0 tx=0x7fb404008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:31.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.256+0000 7f4af47ed640 1 -- 172.21.15.17:0/3213620709 --> [v2:172.21.15.122:6816/929092547,v1:172.21.15.122:6817/929092547] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4aec0a56e0 con 0x7f4ad00a6fe0 2024-04-17T02:22:31.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.256+0000 7f4ae2ffd640 1 -- 172.21.15.17:0/3213620709 <== osd.2 v2:172.21.15.122:6816/929092547 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4aec0a56e0 con 0x7f4ad00a6fe0 2024-04-17T02:22:31.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.257+0000 7f4af47ed640 1 -- 172.21.15.17:0/3213620709 >> [v2:172.21.15.122:6816/929092547,v1:172.21.15.122:6817/929092547] conn(0x7f4ad00a6fe0 msgr2=0x7f4ad00a9420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.257+0000 7f4af47ed640 1 --2- 172.21.15.17:0/3213620709 >> [v2:172.21.15.122:6816/929092547,v1:172.21.15.122:6817/929092547] conn(0x7f4ad00a6fe0 0x7f4ad00a9420 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.257+0000 7f4af47ed640 10 mgrc shutdown 2024-04-17T02:22:31.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.257+0000 7f4af47ed640 1 -- 172.21.15.17:0/3213620709 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f4ad009f480 msgr2=0x7f4ad00a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.257+0000 7f4af47ed640 1 --2- 172.21.15.17:0/3213620709 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f4ad009f480 0x7f4ad00a1940 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4adc006a90 tx=0x7f4adc006a20 comp rx=0 tx=0).stop 2024-04-17T02:22:31.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.257+0000 7f4af47ed640 1 -- 172.21.15.17:0/3213620709 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f4aec0a8000 msgr2=0x7f4aec099cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.257+0000 7f4af47ed640 1 --2- 172.21.15.17:0/3213620709 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f4aec0a8000 0x7f4aec099cb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4ae80098c0 tx=0x7f4ae80046c0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.257+0000 7f4af2d8a640 1 -- 172.21.15.17:0/3213620709 reap_dead start 2024-04-17T02:22:31.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.257+0000 7f4af47ed640 1 -- 172.21.15.17:0/3213620709 shutdown_connections 2024-04-17T02:22:31.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.257+0000 7f4af47ed640 1 -- 172.21.15.17:0/3213620709 >> 172.21.15.17:0/3213620709 conn(0x7f4aec0a6ab0 msgr2=0x7f4aec0a83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:31.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.257+0000 7f4af47ed640 1 -- 172.21.15.17:0/3213620709 shutdown_connections 2024-04-17T02:22:31.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.257+0000 7f4af47ed640 1 -- 172.21.15.17:0/3213620709 wait complete. 2024-04-17T02:22:31.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.259+0000 7f9ea68a1640 1 -- 172.21.15.17:0/3605225829 --> [v2:172.21.15.122:6808/2064593011,v1:172.21.15.122:6809/2064593011] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9ea0143c60 con 0x7f9e8c0a6fe0 2024-04-17T02:22:31.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.260+0000 7f9e9cff9640 1 -- 172.21.15.17:0/3605225829 <== osd.1 v2:172.21.15.122:6808/2064593011 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9ea0143c60 con 0x7f9e8c0a6fe0 2024-04-17T02:22:31.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.260+0000 7f9ea68a1640 1 -- 172.21.15.17:0/3605225829 >> [v2:172.21.15.122:6808/2064593011,v1:172.21.15.122:6809/2064593011] conn(0x7f9e8c0a6fe0 msgr2=0x7f9e8c0a9420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.260+0000 7f9ea68a1640 1 --2- 172.21.15.17:0/3605225829 >> [v2:172.21.15.122:6808/2064593011,v1:172.21.15.122:6809/2064593011] conn(0x7f9e8c0a6fe0 0x7f9e8c0a9420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.260+0000 7f9ea68a1640 10 mgrc shutdown 2024-04-17T02:22:31.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.260+0000 7f9ea68a1640 1 -- 172.21.15.17:0/3605225829 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f9e8c09f480 msgr2=0x7f9e8c0a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.260+0000 7f9ea68a1640 1 --2- 172.21.15.17:0/3605225829 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f9e8c09f480 0x7f9e8c0a1940 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9e90009aa0 tx=0x7f9e90009190 comp rx=0 tx=0).stop 2024-04-17T02:22:31.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.260+0000 7f9ea68a1640 1 -- 172.21.15.17:0/3605225829 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9ea0137570 msgr2=0x7f9ea0143ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.260+0000 7f9ea68a1640 1 --2- 172.21.15.17:0/3605225829 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9ea0137570 0x7f9ea0143ee0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9e9400c450 tx=0x7f9e9400c910 comp rx=0 tx=0).stop 2024-04-17T02:22:31.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.260+0000 7f9ea4e3e640 1 -- 172.21.15.17:0/3605225829 reap_dead start 2024-04-17T02:22:31.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.260+0000 7f9ea68a1640 1 -- 172.21.15.17:0/3605225829 shutdown_connections 2024-04-17T02:22:31.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.260+0000 7f9ea68a1640 1 -- 172.21.15.17:0/3605225829 >> 172.21.15.17:0/3605225829 conn(0x7f9ea00748d0 msgr2=0x7f9ea01365e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:31.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.261+0000 7f9ea68a1640 1 -- 172.21.15.17:0/3605225829 shutdown_connections 2024-04-17T02:22:31.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.261+0000 7f9ea68a1640 1 -- 172.21.15.17:0/3605225829 wait complete. 2024-04-17T02:22:31.291 INFO:teuthology.orchestra.run.smithi017.stdout:38654705671 2024-04-17T02:22:31.292 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-17T02:22:31.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.271+0000 7f995c045640 1 -- 172.21.15.17:0/1593874074 --> [v2:172.21.15.17:6800/1828284343,v1:172.21.15.17:6801/1828284343] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9954132d50 con 0x7f99400a6fe0 2024-04-17T02:22:31.293 INFO:teuthology.orchestra.run.smithi017.stdout:38654705672 2024-04-17T02:22:31.293 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-17T02:22:31.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.271+0000 7f99527fc640 1 -- 172.21.15.17:0/1593874074 <== osd.0 v2:172.21.15.17:6800/1828284343 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9954132d50 con 0x7f99400a6fe0 2024-04-17T02:22:31.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.272+0000 7f995c045640 1 -- 172.21.15.17:0/1593874074 >> [v2:172.21.15.17:6800/1828284343,v1:172.21.15.17:6801/1828284343] conn(0x7f99400a6fe0 msgr2=0x7f99400a9420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.272+0000 7f995c045640 1 --2- 172.21.15.17:0/1593874074 >> [v2:172.21.15.17:6800/1828284343,v1:172.21.15.17:6801/1828284343] conn(0x7f99400a6fe0 0x7f99400a9420 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.272+0000 7f995c045640 10 mgrc shutdown 2024-04-17T02:22:31.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.272+0000 7f995c045640 1 -- 172.21.15.17:0/1593874074 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f994009f480 msgr2=0x7f99400a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.272+0000 7f995c045640 1 --2- 172.21.15.17:0/1593874074 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f994009f480 0x7f99400a1940 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9944009630 tx=0x7f9944008040 comp rx=0 tx=0).stop 2024-04-17T02:22:31.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.272+0000 7f995c045640 1 -- 172.21.15.17:0/1593874074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99540a0520 msgr2=0x7f99541de8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.272+0000 7f995c045640 1 --2- 172.21.15.17:0/1593874074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99540a0520 0x7f99541de8b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f99540a1180 tx=0x7f99480046c0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.272+0000 7f995a5e2640 1 -- 172.21.15.17:0/1593874074 reap_dead start 2024-04-17T02:22:31.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.272+0000 7f995c045640 1 -- 172.21.15.17:0/1593874074 shutdown_connections 2024-04-17T02:22:31.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.272+0000 7f995c045640 1 -- 172.21.15.17:0/1593874074 >> 172.21.15.17:0/1593874074 conn(0x7f99540748d0 msgr2=0x7f99541432e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:31.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.272+0000 7f995c045640 1 -- 172.21.15.17:0/1593874074 shutdown_connections 2024-04-17T02:22:31.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.272+0000 7f995c045640 1 -- 172.21.15.17:0/1593874074 wait complete. 2024-04-17T02:22:31.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.277+0000 7fb418a72640 1 -- 172.21.15.17:0/2423701179 --> [v2:172.21.15.122:6800/204132523,v1:172.21.15.122:6801/204132523] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb41409b480 con 0x7fb3f40a7360 2024-04-17T02:22:31.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.277+0000 7fb40affd640 1 -- 172.21.15.17:0/2423701179 <== osd.3 v2:172.21.15.122:6800/204132523 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb41409b480 con 0x7fb3f40a7360 2024-04-17T02:22:31.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.278+0000 7fb418a72640 1 -- 172.21.15.17:0/2423701179 >> [v2:172.21.15.122:6800/204132523,v1:172.21.15.122:6801/204132523] conn(0x7fb3f40a7360 msgr2=0x7fb3f40a97a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.278+0000 7fb418a72640 1 --2- 172.21.15.17:0/2423701179 >> [v2:172.21.15.122:6800/204132523,v1:172.21.15.122:6801/204132523] conn(0x7fb3f40a7360 0x7fb3f40a97a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.278+0000 7fb418a72640 10 mgrc shutdown 2024-04-17T02:22:31.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.278+0000 7fb418a72640 1 -- 172.21.15.17:0/2423701179 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fb3f409f800 msgr2=0x7fb3f40a1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.278+0000 7fb418a72640 1 --2- 172.21.15.17:0/2423701179 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fb3f409f800 0x7fb3f40a1cc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb4040094a0 tx=0x7fb404008040 comp rx=0 tx=0).stop 2024-04-17T02:22:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.278+0000 7fb418a72640 1 -- 172.21.15.17:0/2423701179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb414142c90 msgr2=0x7fb414148b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.278+0000 7fb418a72640 1 --2- 172.21.15.17:0/2423701179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb414142c90 0x7fb414148b20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb40c033000 tx=0x7fb40c004a40 comp rx=0 tx=0).stop 2024-04-17T02:22:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.278+0000 7fb412d9d640 1 -- 172.21.15.17:0/2423701179 reap_dead start 2024-04-17T02:22:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.278+0000 7fb418a72640 1 -- 172.21.15.17:0/2423701179 shutdown_connections 2024-04-17T02:22:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.278+0000 7fb418a72640 1 -- 172.21.15.17:0/2423701179 >> 172.21.15.17:0/2423701179 conn(0x7fb4140ba940 msgr2=0x7fb41406b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.278+0000 7fb418a72640 1 -- 172.21.15.17:0/2423701179 shutdown_connections 2024-04-17T02:22:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.278+0000 7fb418a72640 1 -- 172.21.15.17:0/2423701179 wait complete. 2024-04-17T02:22:31.299 INFO:teuthology.orchestra.run.smithi017.stdout:38654705672 2024-04-17T02:22:31.299 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-17T02:22:31.300 INFO:teuthology.orchestra.run.smithi017.stdout:38654705672 2024-04-17T02:22:31.300 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-17T02:22:31.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.441+0000 7f9a58320640 1 Processor -- start 2024-04-17T02:22:31.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.441+0000 7f53796ed640 1 Processor -- start 2024-04-17T02:22:31.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.441+0000 7f9a58320640 1 -- start start 2024-04-17T02:22:31.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.442+0000 7f52aca07640 1 Processor -- start 2024-04-17T02:22:31.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.442+0000 7f53796ed640 1 -- start start 2024-04-17T02:22:31.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.442+0000 7f0c24806640 1 Processor -- start 2024-04-17T02:22:31.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.442+0000 7f0c24806640 1 -- start start 2024-04-17T02:22:31.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.442+0000 7f52aca07640 1 -- start start 2024-04-17T02:22:31.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.442+0000 7f53796ed640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f53740a61c0 0x7f53740b7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.442+0000 7f53796ed640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5374071350 0x7f5374145980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.442+0000 7f53796ed640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5374142860 con 0x7f5374071ae0 2024-04-17T02:22:31.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.442+0000 7f53796ed640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f5374142630 con 0x7f53740a61c0 2024-04-17T02:22:31.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.442+0000 7f53796ed640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f53740b84e0 con 0x7f5374071350 2024-04-17T02:22:31.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.442+0000 7f5372ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f53740a61c0 0x7f53740b7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.442+0000 7f9a58320640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9a50152e30 0x7f9a50155220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.442+0000 7f9a58320640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a500ab470 con 0x7f9a5014cd70 2024-04-17T02:22:31.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.442+0000 7f5372ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f53740a61c0 0x7f53740b7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52374/0 (socket says 172.21.15.17:52374) 2024-04-17T02:22:31.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.442+0000 7f9a58320640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a500a8900 con 0x7f9a500a9580 2024-04-17T02:22:31.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.442+0000 7f5372ffd640 1 -- 172.21.15.17:0/4105966636 learned_addr learned my addr 172.21.15.17:0/4105966636 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:31.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.443+0000 7f9a58320640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f9a500a7ae0 con 0x7f9a50152e30 2024-04-17T02:22:31.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.442+0000 7f9a560bc640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f9a5014cd70 0x7f9a500a81f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42006/0 (socket says 172.21.15.17:42006) 2024-04-17T02:22:31.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.443+0000 7f9a560bc640 1 -- 172.21.15.17:0/1661115294 learned_addr learned my addr 172.21.15.17:0/1661115294 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:22:31.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.443+0000 7f53737fe640 1 --2- 172.21.15.17:0/4105966636 >> v2:172.21.15.122:3300/0 conn(0x7f5374071350 0x7f5374145980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.443+0000 7f52aca07640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f52a80ab5b0 0x7f52a80ac680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.443+0000 7f52aca07640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f52a8142c90 0x7f52a814fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.443+0000 7f52aca07640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52a80acea0 con 0x7f52a80bb460 2024-04-17T02:22:31.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.443+0000 7f52aca07640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f52a80ab990 con 0x7f52a80ab5b0 2024-04-17T02:22:31.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.443+0000 7f52aca07640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f52a806c330 con 0x7f52a8142c90 2024-04-17T02:22:31.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.443+0000 7f9a568bd640 1 --2- 172.21.15.17:0/1661115294 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9a50152e30 0x7f9a50155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.443+0000 7f52a6d9d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f52a8142c90 0x7f52a814fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.443+0000 7f52a659c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f52a80ab5b0 0x7f52a80ac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.443+0000 7f5371ffb640 1 -- 172.21.15.17:0/4105966636 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2960269095 0 0) 0x7f5374142860 con 0x7f5374071ae0 2024-04-17T02:22:31.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.443+0000 7f5371ffb640 1 -- 172.21.15.17:0/4105966636 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5360003520 con 0x7f5374071ae0 2024-04-17T02:22:31.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.443+0000 7f52a6d9d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f52a8142c90 0x7f52a814fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.17:42308/0 (socket says 172.21.15.17:42308) 2024-04-17T02:22:31.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.443+0000 7f52a6d9d640 1 -- 172.21.15.17:0/2118899166 learned_addr learned my addr 172.21.15.17:0/2118899166 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:31.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.443+0000 7f0c24806640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f0c200ab5b0 0x7f0c200ac680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.443+0000 7f0c24806640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0c20142c90 0x7f0c2014fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.443+0000 7f5372ffd640 1 -- 172.21.15.17:0/4105966636 >> v2:172.21.15.122:3300/0 conn(0x7f5374071350 msgr2=0x7f5374145980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:31.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.443+0000 7f5372ffd640 1 --2- 172.21.15.17:0/4105966636 >> v2:172.21.15.122:3300/0 conn(0x7f5374071350 0x7f5374145980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.443+0000 7f5372ffd640 1 -- 172.21.15.17:0/4105966636 >> v1:172.21.15.122:6789/0 conn(0x7f5374071ae0 legacy=0x7f5374145270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.443+0000 7f0c24806640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c200acea0 con 0x7f0c200bb460 2024-04-17T02:22:31.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.443+0000 7f0c24806640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f0c200ab990 con 0x7f0c20142c90 2024-04-17T02:22:31.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.443+0000 7f0c24806640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f0c2006c330 con 0x7f0c200ab5b0 2024-04-17T02:22:31.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.443+0000 7f9a550ba640 1 -- 172.21.15.17:0/1661115294 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3614834307 0 0) 0x7f9a4c001110 con 0x7f9a5014cd70 2024-04-17T02:22:31.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.443+0000 7f9a550ba640 1 -- 172.21.15.17:0/1661115294 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a3c003520 con 0x7f9a5014cd70 2024-04-17T02:22:31.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.443+0000 7f9a550ba640 1 -- 172.21.15.17:0/1661115294 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1888640858 0 0) 0x7f9a40001110 con 0x7f9a500a9580 2024-04-17T02:22:31.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.443+0000 7f9a550ba640 1 -- 172.21.15.17:0/1661115294 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a4c001110 con 0x7f9a500a9580 2024-04-17T02:22:31.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.443+0000 7f5372ffd640 1 -- 172.21.15.17:0/4105966636 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53740a65a0 con 0x7f53740a61c0 2024-04-17T02:22:31.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.443+0000 7f53737fe640 1 --2- 172.21.15.17:0/4105966636 >> v2:172.21.15.122:3300/0 conn(0x7f5374071350 0x7f5374145980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:31.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.443+0000 7f52a5d9b640 1 -- 172.21.15.17:0/2118899166 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1632885770 0 0) 0x7f52a80acea0 con 0x7f52a80bb460 2024-04-17T02:22:31.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.443+0000 7f9a568bd640 1 -- 172.21.15.17:0/1661115294 >> v1:172.21.15.122:6789/0 conn(0x7f9a500a9580 legacy=0x7f9a5014d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.443+0000 7f9a550ba640 1 -- 172.21.15.17:0/1661115294 <== mon.1 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2591905778 0 0) 0x7f9a4c001110 con 0x7f9a500a9580 2024-04-17T02:22:31.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.443+0000 7f9a568bd640 1 -- 172.21.15.17:0/1661115294 >> v1:172.21.15.17:6789/0 conn(0x7f9a5014cd70 legacy=0x7f9a500a81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.443+0000 7f9a568bd640 1 -- 172.21.15.17:0/1661115294 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a500a7da0 con 0x7f9a50152e30 2024-04-17T02:22:31.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.443+0000 7f52a5d9b640 1 -- 172.21.15.17:0/2118899166 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5294003520 con 0x7f52a80bb460 2024-04-17T02:22:31.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.444+0000 7f52a6d9d640 1 -- 172.21.15.17:0/2118899166 >> v2:172.21.15.17:3300/0 conn(0x7f52a80ab5b0 msgr2=0x7f52a80ac680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:31.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.444+0000 7f52a6d9d640 1 --2- 172.21.15.17:0/2118899166 >> v2:172.21.15.17:3300/0 conn(0x7f52a80ab5b0 0x7f52a80ac680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.444+0000 7f52a6d9d640 1 -- 172.21.15.17:0/2118899166 >> v1:172.21.15.122:6789/0 conn(0x7f52a80bb460 legacy=0x7f52a8142580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.444+0000 7f52a6d9d640 1 -- 172.21.15.17:0/2118899166 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52a80acbc0 con 0x7f52a8142c90 2024-04-17T02:22:31.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.444+0000 7f0c17fff640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f0c200bb460 0x7f0c20142580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.17:32986/0 (socket says 172.21.15.17:32986) 2024-04-17T02:22:31.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.444+0000 7f0c17fff640 1 -- 172.21.15.17:0/2481483490 learned_addr learned my addr 172.21.15.17:0/2481483490 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:22:31.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.444+0000 7f0c1e59c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f0c200ab5b0 0x7f0c200ac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.444+0000 7f52a659c640 1 --2- 172.21.15.17:0/2118899166 >> v2:172.21.15.17:3300/0 conn(0x7f52a80ab5b0 0x7f52a80ac680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T02:22:31.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.444+0000 7f0c1ed9d640 1 --2- 172.21.15.17:0/2481483490 >> v2:172.21.15.17:3300/0 conn(0x7f0c20142c90 0x7f0c2014fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.444+0000 7f0c1dd9b640 1 -- 172.21.15.17:0/2481483490 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2806542762 0 0) 0x7f0c200acea0 con 0x7f0c200bb460 2024-04-17T02:22:31.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.444+0000 7f0c1dd9b640 1 -- 172.21.15.17:0/2481483490 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c0c003520 con 0x7f0c200bb460 2024-04-17T02:22:31.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.444+0000 7f0c1e59c640 1 -- 172.21.15.17:0/2481483490 >> v2:172.21.15.17:3300/0 conn(0x7f0c20142c90 msgr2=0x7f0c2014fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:31.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.444+0000 7f0c1e59c640 1 --2- 172.21.15.17:0/2481483490 >> v2:172.21.15.17:3300/0 conn(0x7f0c20142c90 0x7f0c2014fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.444+0000 7f0c1e59c640 1 -- 172.21.15.17:0/2481483490 >> v1:172.21.15.122:6789/0 conn(0x7f0c200bb460 legacy=0x7f0c20142580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.444+0000 7f0c1e59c640 1 -- 172.21.15.17:0/2481483490 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c200acbc0 con 0x7f0c200ab5b0 2024-04-17T02:22:31.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.444+0000 7f5372ffd640 1 --2- 172.21.15.17:0/4105966636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53740a61c0 0x7f53740b7fa0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5374142460 tx=0x7f536c02e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e8d1f430bcaf501 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:31.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.444+0000 7f52a6d9d640 1 --2- 172.21.15.17:0/2118899166 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52a8142c90 0x7f52a814fa90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f52a80abdb0 tx=0x7f52a002bf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42131d506187b37f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:31.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.444+0000 7f9a568bd640 1 --2- 172.21.15.17:0/1661115294 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9a50152e30 0x7f9a50155220 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9a48009dc0 tx=0x7f9a4802bc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e899eeb681aa24fb server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:31.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.445+0000 7f5371ffb640 1 -- 172.21.15.17:0/4105966636 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f536c02ea10 con 0x7f53740a61c0 2024-04-17T02:22:31.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.445+0000 7f5371ffb640 1 -- 172.21.15.17:0/4105966636 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f536c02ebb0 con 0x7f53740a61c0 2024-04-17T02:22:31.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.445+0000 7f5371ffb640 1 -- 172.21.15.17:0/4105966636 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f536c009600 con 0x7f53740a61c0 2024-04-17T02:22:31.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.445+0000 7f52a5d9b640 1 -- 172.21.15.17:0/2118899166 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a002cb10 con 0x7f52a8142c90 2024-04-17T02:22:31.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.445+0000 7f52a5d9b640 1 -- 172.21.15.17:0/2118899166 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52a002ccb0 con 0x7f52a8142c90 2024-04-17T02:22:31.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.445+0000 7f9a550ba640 1 -- 172.21.15.17:0/1661115294 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a48039070 con 0x7f9a50152e30 2024-04-17T02:22:31.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.445+0000 7f52a5d9b640 1 -- 172.21.15.17:0/2118899166 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a002ce60 con 0x7f52a8142c90 2024-04-17T02:22:31.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.445+0000 7f9a550ba640 1 -- 172.21.15.17:0/1661115294 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a4802c770 con 0x7f9a50152e30 2024-04-17T02:22:31.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.445+0000 7f9a550ba640 1 -- 172.21.15.17:0/1661115294 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c0017c0 con 0x7f9a50152e30 2024-04-17T02:22:31.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.445+0000 7f0c1e59c640 1 --2- 172.21.15.17:0/2481483490 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c200ab5b0 0x7f0c200ac680 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0c2006cde0 tx=0x7f0c1002bec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31369f0f2d2f5d1d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:31.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.445+0000 7f0c1dd9b640 1 -- 172.21.15.17:0/2481483490 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c10039070 con 0x7f0c200ab5b0 2024-04-17T02:22:31.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.445+0000 7f0c1dd9b640 1 -- 172.21.15.17:0/2481483490 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c1002cc70 con 0x7f0c200ab5b0 2024-04-17T02:22:31.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.445+0000 7f0c1dd9b640 1 -- 172.21.15.17:0/2481483490 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c10034660 con 0x7f0c200ab5b0 2024-04-17T02:22:31.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.445+0000 7f53796ed640 1 -- 172.21.15.17:0/4105966636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53740a61c0 msgr2=0x7f53740b7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.445+0000 7f53796ed640 1 --2- 172.21.15.17:0/4105966636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53740a61c0 0x7f53740b7fa0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5374142460 tx=0x7f536c02e070 comp rx=0 tx=0).stop 2024-04-17T02:22:31.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.446+0000 7f53796ed640 1 -- 172.21.15.17:0/4105966636 shutdown_connections 2024-04-17T02:22:31.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.446+0000 7f53796ed640 1 --2- 172.21.15.17:0/4105966636 >> v2:172.21.15.122:3300/0 conn(0x7f5374071350 0x7f5374145980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.446+0000 7f53796ed640 1 --2- 172.21.15.17:0/4105966636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53740a61c0 0x7f53740b7fa0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.446+0000 7f53796ed640 1 -- 172.21.15.17:0/4105966636 >> 172.21.15.17:0/4105966636 conn(0x7f53740743e0 msgr2=0x7f53740747f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:31.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.446+0000 7f53796ed640 1 -- 172.21.15.17:0/4105966636 shutdown_connections 2024-04-17T02:22:31.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.446+0000 7f53796ed640 1 -- 172.21.15.17:0/4105966636 wait complete. 2024-04-17T02:22:31.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.446+0000 7f52aca07640 1 -- 172.21.15.17:0/2118899166 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52a8142c90 msgr2=0x7f52a814fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.446+0000 7f52aca07640 1 --2- 172.21.15.17:0/2118899166 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52a8142c90 0x7f52a814fa90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f52a80abdb0 tx=0x7f52a002bf70 comp rx=0 tx=0).stop 2024-04-17T02:22:31.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.446+0000 7f9a58320640 1 -- 172.21.15.17:0/1661115294 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9a50152e30 msgr2=0x7f9a50155220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.446+0000 7f9a58320640 1 --2- 172.21.15.17:0/1661115294 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9a50152e30 0x7f9a50155220 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9a48009dc0 tx=0x7f9a4802bc40 comp rx=0 tx=0).stop 2024-04-17T02:22:31.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.446+0000 7f52aca07640 1 -- 172.21.15.17:0/2118899166 shutdown_connections 2024-04-17T02:22:31.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.446+0000 7f52aca07640 1 --2- 172.21.15.17:0/2118899166 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52a8142c90 0x7f52a814fa90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.446+0000 7f52aca07640 1 --2- 172.21.15.17:0/2118899166 >> v2:172.21.15.17:3300/0 conn(0x7f52a80ab5b0 0x7f52a80ac680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.446+0000 7f52aca07640 1 -- 172.21.15.17:0/2118899166 >> 172.21.15.17:0/2118899166 conn(0x7f52a80ba940 msgr2=0x7f52a80bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:31.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.446+0000 7f52aca07640 1 -- 172.21.15.17:0/2118899166 shutdown_connections 2024-04-17T02:22:31.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.446+0000 7f9a58320640 1 -- 172.21.15.17:0/1661115294 shutdown_connections 2024-04-17T02:22:31.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.446+0000 7f9a58320640 1 --2- 172.21.15.17:0/1661115294 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9a50152e30 0x7f9a50155220 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.446+0000 7f9a58320640 1 -- 172.21.15.17:0/1661115294 >> 172.21.15.17:0/1661115294 conn(0x7f9a500ba940 msgr2=0x7f9a500bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:31.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.446+0000 7f52aca07640 1 -- 172.21.15.17:0/2118899166 wait complete. 2024-04-17T02:22:31.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.446+0000 7f9a58320640 1 -- 172.21.15.17:0/1661115294 shutdown_connections 2024-04-17T02:22:31.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.446+0000 7f9a58320640 1 -- 172.21.15.17:0/1661115294 wait complete. 2024-04-17T02:22:31.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.446+0000 7f0c24806640 1 -- 172.21.15.17:0/2481483490 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c200ab5b0 msgr2=0x7f0c200ac680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.446+0000 7f0c24806640 1 --2- 172.21.15.17:0/2481483490 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c200ab5b0 0x7f0c200ac680 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0c2006cde0 tx=0x7f0c1002bec0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.446+0000 7f0c24806640 1 -- 172.21.15.17:0/2481483490 shutdown_connections 2024-04-17T02:22:31.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.446+0000 7f0c24806640 1 --2- 172.21.15.17:0/2481483490 >> v2:172.21.15.17:3300/0 conn(0x7f0c20142c90 0x7f0c2014fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.446+0000 7f0c24806640 1 --2- 172.21.15.17:0/2481483490 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c200ab5b0 0x7f0c200ac680 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.446+0000 7f0c24806640 1 -- 172.21.15.17:0/2481483490 >> 172.21.15.17:0/2481483490 conn(0x7f0c200ba940 msgr2=0x7f0c200bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:31.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.446+0000 7f0c24806640 1 -- 172.21.15.17:0/2481483490 shutdown_connections 2024-04-17T02:22:31.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.446+0000 7f0c24806640 1 -- 172.21.15.17:0/2481483490 wait complete. 2024-04-17T02:22:31.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.447+0000 7f52aca07640 1 Processor -- start 2024-04-17T02:22:31.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.447+0000 7f9a58320640 1 Processor -- start 2024-04-17T02:22:31.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.447+0000 7f52aca07640 1 -- start start 2024-04-17T02:22:31.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.447+0000 7f9a58320640 1 -- start start 2024-04-17T02:22:31.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.447+0000 7f53796ed640 1 Processor -- start 2024-04-17T02:22:31.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.447+0000 7f53796ed640 1 -- start start 2024-04-17T02:22:31.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.448+0000 7f0c24806640 1 Processor -- start 2024-04-17T02:22:31.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.448+0000 7f0c24806640 1 -- start start 2024-04-17T02:22:31.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.448+0000 7f53796ed640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5374071350 0x7f5374144f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.448+0000 7f53796ed640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5374071ae0 0x7f53740a3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.448+0000 7f53796ed640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f53740a61c0 0x7f53740a21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.448+0000 7f53796ed640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f537406b280 con 0x7f5374071ae0 2024-04-17T02:22:31.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.448+0000 7f53796ed640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f537406b100 con 0x7f5374071350 2024-04-17T02:22:31.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.448+0000 7f53796ed640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f537406b400 con 0x7f53740a61c0 2024-04-17T02:22:31.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.448+0000 7f9a58320640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a500a9580 0x7f9a50071930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.448+0000 7f52aca07640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f52a80ab5b0 0x7f52a813cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.448+0000 7f52aca07640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52a80bb460 0x7f52a8146560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.448+0000 7f9a58320640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a5014cd70 0x7f9a50070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.448+0000 7f52aca07640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52a8142c90 0x7f52a81d9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.448+0000 7f52aca07640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f52a80a9700 con 0x7f52a80bb460 2024-04-17T02:22:31.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.448+0000 7f52aca07640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f52a80a7400 con 0x7f52a8142c90 2024-04-17T02:22:31.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.448+0000 7f52aca07640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f52a80a9880 con 0x7f52a80ab5b0 2024-04-17T02:22:31.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.448+0000 7f529ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52a80bb460 0x7f52a8146560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.448+0000 7f529ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52a80bb460 0x7f52a8146560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52420/0 (socket says 172.21.15.17:52420) 2024-04-17T02:22:31.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.448+0000 7f529ffff640 1 -- 172.21.15.17:0/3249156840 learned_addr learned my addr 172.21.15.17:0/3249156840 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:31.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.448+0000 7f9a560bc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a500a9580 0x7f9a50071930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.449+0000 7f52a659c640 1 --2- 172.21.15.17:0/3249156840 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f52a80ab5b0 0x7f52a813cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.449+0000 7f52a6d9d640 1 --2- 172.21.15.17:0/3249156840 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52a8142c90 0x7f52a81d9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.449+0000 7f0c24806640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c200ab5b0 0x7f0c201db010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.448+0000 7f53737fe640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f53740a61c0 0x7f53740a21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.448+0000 7f53737fe640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f53740a61c0 0x7f53740a21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:53012/0 (socket says 172.21.15.17:53012) 2024-04-17T02:22:31.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.448+0000 7f53737fe640 1 -- 172.21.15.17:0/4068226153 learned_addr learned my addr 172.21.15.17:0/4068226153 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:31.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.448+0000 7f53727fc640 1 --2- 172.21.15.17:0/4068226153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5374071ae0 0x7f53740a3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.448+0000 7f53737fe640 1 -- 172.21.15.17:0/4068226153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5374071350 msgr2=0x7f5374144f10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-17T02:22:31.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.448+0000 7f53737fe640 1 --2- 172.21.15.17:0/4068226153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5374071350 0x7f5374144f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.448+0000 7f53737fe640 1 -- 172.21.15.17:0/4068226153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5374071ae0 msgr2=0x7f53740a3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.448+0000 7f53737fe640 1 --2- 172.21.15.17:0/4068226153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5374071ae0 0x7f53740a3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.449+0000 7f53737fe640 1 -- 172.21.15.17:0/4068226153 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f537413eea0 con 0x7f53740a61c0 2024-04-17T02:22:31.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.449+0000 7f53737fe640 1 --2- 172.21.15.17:0/4068226153 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f53740a61c0 0x7f53740a21b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f536400e960 tx=0x7f536400ee20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:31.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.448+0000 7f9a560bc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a500a9580 0x7f9a50071930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.17:42354/0 (socket says 172.21.15.17:42354) 2024-04-17T02:22:31.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.449+0000 7f9a58320640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9a50152e30 0x7f9a50071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.449+0000 7f9a58320640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9a5014d860 con 0x7f9a5014cd70 2024-04-17T02:22:31.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.449+0000 7f9a58320640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9a500aaef0 con 0x7f9a500a9580 2024-04-17T02:22:31.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.449+0000 7f9a58320640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f9a5014d9e0 con 0x7f9a50152e30 2024-04-17T02:22:31.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.449+0000 7f9a560bc640 1 -- 172.21.15.17:0/3514851113 learned_addr learned my addr 172.21.15.17:0/3514851113 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:31.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.449+0000 7f9a558bb640 1 --2- 172.21.15.17:0/3514851113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a5014cd70 0x7f9a50070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.449+0000 7f9a568bd640 1 --2- 172.21.15.17:0/3514851113 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9a50152e30 0x7f9a50071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.449+0000 7f536b7fe640 1 -- 172.21.15.17:0/4068226153 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5364017070 con 0x7f53740a61c0 2024-04-17T02:22:31.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.449+0000 7f0c24806640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c200bb460 0x7f0c20148cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.449+0000 7f53796ed640 1 -- 172.21.15.17:0/4068226153 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53741d9730 con 0x7f53740a61c0 2024-04-17T02:22:31.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.449+0000 7f536b7fe640 1 -- 172.21.15.17:0/4068226153 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5364004020 con 0x7f53740a61c0 2024-04-17T02:22:31.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.449+0000 7f536b7fe640 1 -- 172.21.15.17:0/4068226153 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5364004410 con 0x7f53740a61c0 2024-04-17T02:22:31.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.449+0000 7f0c24806640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f0c20142c90 0x7f0c2013d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.449+0000 7f53796ed640 1 -- 172.21.15.17:0/4068226153 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f537413ec60 con 0x7f53740a61c0 2024-04-17T02:22:31.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.449+0000 7f9a558bb640 1 -- 172.21.15.17:0/3514851113 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9a50152e30 msgr2=0x7f9a50071010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.449+0000 7f9a558bb640 1 --2- 172.21.15.17:0/3514851113 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9a50152e30 0x7f9a50071010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.449+0000 7f9a558bb640 1 -- 172.21.15.17:0/3514851113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a500a9580 msgr2=0x7f9a50071930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.449+0000 7f9a558bb640 1 --2- 172.21.15.17:0/3514851113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a500a9580 0x7f9a50071930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.449+0000 7f9a558bb640 1 -- 172.21.15.17:0/3514851113 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a50143250 con 0x7f9a5014cd70 2024-04-17T02:22:31.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.449+0000 7f0c1e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c200ab5b0 0x7f0c201db010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.449+0000 7f0c1e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c200ab5b0 0x7f0c201db010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52424/0 (socket says 172.21.15.17:52424) 2024-04-17T02:22:31.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.449+0000 7f0c1ed9d640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f0c20142c90 0x7f0c2013d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.449+0000 7f0c1ed9d640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f0c20142c90 0x7f0c2013d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:53034/0 (socket says 172.21.15.17:53034) 2024-04-17T02:22:31.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.449+0000 7f0c17fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c200bb460 0x7f0c20148cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.450+0000 7f0c17fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c200bb460 0x7f0c20148cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.17:42374/0 (socket says 172.21.15.17:42374) 2024-04-17T02:22:31.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.450+0000 7f0c1e59c640 1 -- 172.21.15.17:0/720576100 learned_addr learned my addr 172.21.15.17:0/720576100 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:31.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.450+0000 7f9a558bb640 1 --2- 172.21.15.17:0/3514851113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a5014cd70 0x7f9a50070ad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9a4000c6d0 tx=0x7f9a4000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:31.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.450+0000 7f0c24806640 1 -- 172.21.15.17:0/720576100 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0c200a9700 con 0x7f0c200ab5b0 2024-04-17T02:22:31.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.450+0000 7f0c24806640 1 -- 172.21.15.17:0/720576100 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0c200a7400 con 0x7f0c200bb460 2024-04-17T02:22:31.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.450+0000 7f0c24806640 1 -- 172.21.15.17:0/720576100 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f0c200a9880 con 0x7f0c20142c90 2024-04-17T02:22:31.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.450+0000 7f52a659c640 1 -- 172.21.15.17:0/3249156840 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52a8142c90 msgr2=0x7f52a81d9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.450+0000 7f52a659c640 1 --2- 172.21.15.17:0/3249156840 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52a8142c90 0x7f52a81d9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.450+0000 7f52a659c640 1 -- 172.21.15.17:0/3249156840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52a80bb460 msgr2=0x7f52a8146560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.450+0000 7f52a659c640 1 --2- 172.21.15.17:0/3249156840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52a80bb460 0x7f52a8146560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.450+0000 7f52a659c640 1 -- 172.21.15.17:0/3249156840 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52a8147370 con 0x7f52a80ab5b0 2024-04-17T02:22:31.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.450+0000 7f9a46ffd640 1 -- 172.21.15.17:0/3514851113 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a40016020 con 0x7f9a5014cd70 2024-04-17T02:22:31.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.450+0000 7f9a46ffd640 1 -- 172.21.15.17:0/3514851113 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a4000a840 con 0x7f9a5014cd70 2024-04-17T02:22:31.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.450+0000 7f9a58320640 1 -- 172.21.15.17:0/3514851113 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a500702f0 con 0x7f9a5014cd70 2024-04-17T02:22:31.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.450+0000 7f9a58320640 1 -- 172.21.15.17:0/3514851113 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a50148480 con 0x7f9a5014cd70 2024-04-17T02:22:31.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.450+0000 7f52a6d9d640 1 --2- 172.21.15.17:0/3249156840 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52a8142c90 0x7f52a81d9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T02:22:31.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.450+0000 7f0c1ed9d640 1 -- 172.21.15.17:0/720576100 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c200bb460 msgr2=0x7f0c20148cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.450+0000 7f0c1ed9d640 1 --2- 172.21.15.17:0/720576100 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c200bb460 0x7f0c20148cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.450+0000 7f0c1ed9d640 1 -- 172.21.15.17:0/720576100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c200ab5b0 msgr2=0x7f0c201db010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.450+0000 7f0c1ed9d640 1 --2- 172.21.15.17:0/720576100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c200ab5b0 0x7f0c201db010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.450+0000 7f0c1ed9d640 1 -- 172.21.15.17:0/720576100 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c201dab50 con 0x7f0c20142c90 2024-04-17T02:22:31.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.450+0000 7f0c17fff640 1 --2- 172.21.15.17:0/720576100 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c200bb460 0x7f0c20148cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T02:22:31.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.450+0000 7f52a659c640 1 --2- 172.21.15.17:0/3249156840 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f52a80ab5b0 0x7f52a813cee0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f529800e810 tx=0x7f529800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:31.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.450+0000 7f9a46ffd640 1 -- 172.21.15.17:0/3514851113 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a4000ac70 con 0x7f9a5014cd70 2024-04-17T02:22:31.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.450+0000 7f53796ed640 1 -- 172.21.15.17:0/4068226153 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53741cd040 con 0x7f53740a61c0 2024-04-17T02:22:31.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.451+0000 7f529effd640 1 -- 172.21.15.17:0/3249156840 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529800f040 con 0x7f52a80ab5b0 2024-04-17T02:22:31.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.451+0000 7f529effd640 1 -- 172.21.15.17:0/3249156840 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5298004030 con 0x7f52a80ab5b0 2024-04-17T02:22:31.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.451+0000 7f529effd640 1 -- 172.21.15.17:0/3249156840 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5298004400 con 0x7f52a80ab5b0 2024-04-17T02:22:31.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.451+0000 7f529ffff640 1 --2- 172.21.15.17:0/3249156840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52a80bb460 0x7f52a8146560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:31.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.451+0000 7f0c1ed9d640 1 --2- 172.21.15.17:0/720576100 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f0c20142c90 0x7f0c2013d5c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0c1800d460 tx=0x7f0c1800d920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:31.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.451+0000 7f0c16ffd640 1 -- 172.21.15.17:0/720576100 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c18004020 con 0x7f0c20142c90 2024-04-17T02:22:31.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.451+0000 7f0c16ffd640 1 -- 172.21.15.17:0/720576100 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c180041e0 con 0x7f0c20142c90 2024-04-17T02:22:31.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.451+0000 7f52aca07640 1 -- 172.21.15.17:0/3249156840 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52a8147c80 con 0x7f52a80ab5b0 2024-04-17T02:22:31.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.451+0000 7f52aca07640 1 -- 172.21.15.17:0/3249156840 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f52a8144430 con 0x7f52a80ab5b0 2024-04-17T02:22:31.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.452+0000 7f0c16ffd640 1 -- 172.21.15.17:0/720576100 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c180043d0 con 0x7f0c20142c90 2024-04-17T02:22:31.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.452+0000 7f0c24806640 1 -- 172.21.15.17:0/720576100 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c201db550 con 0x7f0c20142c90 2024-04-17T02:22:31.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.452+0000 7f0c24806640 1 -- 172.21.15.17:0/720576100 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c2013e470 con 0x7f0c20142c90 2024-04-17T02:22:31.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.451+0000 7f9a58320640 1 -- 172.21.15.17:0/3514851113 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a38005080 con 0x7f9a5014cd70 2024-04-17T02:22:31.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.452+0000 7f536b7fe640 1 -- 172.21.15.17:0/4068226153 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f536400ca00 con 0x7f53740a61c0 2024-04-17T02:22:31.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.452+0000 7f536b7fe640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:31.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.453+0000 7f0c24806640 1 -- 172.21.15.17:0/720576100 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c200687f0 con 0x7f0c20142c90 2024-04-17T02:22:31.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.453+0000 7f529cff9640 1 -- 172.21.15.17:0/3249156840 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52a80ba0a0 con 0x7f52a80ab5b0 2024-04-17T02:22:31.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.453+0000 7f536b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:31.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.453+0000 7f536b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:31.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.453+0000 7f536b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:31.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.453+0000 7f536b7fe640 1 --2- 172.21.15.17:0/4068226153 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f535409f400 0x7f53540a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.454+0000 7f9a46ffd640 1 -- 172.21.15.17:0/3514851113 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f9a40019020 con 0x7f9a5014cd70 2024-04-17T02:22:31.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.454+0000 7f536b7fe640 1 -- 172.21.15.17:0/4068226153 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f53640c93a0 con 0x7f53740a61c0 2024-04-17T02:22:31.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.454+0000 7f9a46ffd640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:31.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.454+0000 7f5372ffd640 1 --2- 172.21.15.17:0/4068226153 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f535409f400 0x7f53540a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.454+0000 7f9a46ffd640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:31.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.454+0000 7f9a46ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:31.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.454+0000 7f9a46ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:31.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.454+0000 7f9a46ffd640 1 --2- 172.21.15.17:0/3514851113 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f9a3409f550 0x7f9a340a1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.454+0000 7f5372ffd640 1 --2- 172.21.15.17:0/4068226153 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f535409f400 0x7f53540a18c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f536c037000 tx=0x7f536c032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:31.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.454+0000 7f9a46ffd640 1 -- 172.21.15.17:0/3514851113 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f9a400c9ce0 con 0x7f9a5014cd70 2024-04-17T02:22:31.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.455+0000 7f0c16ffd640 1 -- 172.21.15.17:0/720576100 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f0c1801b020 con 0x7f0c20142c90 2024-04-17T02:22:31.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.455+0000 7f0c16ffd640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:31.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.455+0000 7f9a560bc640 1 --2- 172.21.15.17:0/3514851113 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f9a3409f550 0x7f9a340a1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.455+0000 7f529effd640 1 -- 172.21.15.17:0/3249156840 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f529800c6d0 con 0x7f52a80ab5b0 2024-04-17T02:22:31.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.455+0000 7f529effd640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:31.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.455+0000 7f0c16ffd640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:31.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.455+0000 7f0c16ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:31.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.455+0000 7f0c16ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:31.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.455+0000 7f0c16ffd640 1 --2- 172.21.15.17:0/720576100 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f0c0009f530 0x7f0c000a19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.456+0000 7f0c16ffd640 1 -- 172.21.15.17:0/720576100 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f0c180c9c00 con 0x7f0c20142c90 2024-04-17T02:22:31.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.456+0000 7f0c1e59c640 1 --2- 172.21.15.17:0/720576100 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f0c0009f530 0x7f0c000a19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.456+0000 7f529effd640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:31.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.456+0000 7f529effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:31.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.456+0000 7f529effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:31.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.456+0000 7f529effd640 1 --2- 172.21.15.17:0/3249156840 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f528809f5d0 0x7f52880a1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:31.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.456+0000 7f9a560bc640 1 --2- 172.21.15.17:0/3514851113 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f9a3409f550 0x7f9a340a1a10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c000f60 tx=0x7f9a4c001ac0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:31.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.456+0000 7f529ffff640 1 --2- 172.21.15.17:0/3249156840 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f528809f5d0 0x7f52880a1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:31.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.456+0000 7f529effd640 1 -- 172.21.15.17:0/3249156840 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f52980c9100 con 0x7f52a80ab5b0 2024-04-17T02:22:31.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.456+0000 7f0c1e59c640 1 --2- 172.21.15.17:0/720576100 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f0c0009f530 0x7f0c000a19f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0c10009bd0 tx=0x7f0c10030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:31.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.456+0000 7f529ffff640 1 --2- 172.21.15.17:0/3249156840 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f528809f5d0 0x7f52880a1a90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f52a81dbe30 tx=0x7f5290009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:31.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.458+0000 7f9a46ffd640 1 -- 172.21.15.17:0/3514851113 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f9a40020020 con 0x7f9a5014cd70 2024-04-17T02:22:31.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.459+0000 7f536b7fe640 1 -- 172.21.15.17:0/4068226153 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f5364098400 con 0x7f53740a61c0 2024-04-17T02:22:31.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.463+0000 7f0c16ffd640 1 -- 172.21.15.17:0/720576100 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0c201db550 con 0x7f0c20142c90 2024-04-17T02:22:31.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.467+0000 7f529effd640 1 -- 172.21.15.17:0/3249156840 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f52a80ba0a0 con 0x7f52a80ab5b0 2024-04-17T02:22:31.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.684+0000 7f53796ed640 1 -- 172.21.15.17:0/4068226153 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f5374067f80 con 0x7f53740a61c0 2024-04-17T02:22:31.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.685+0000 7f536b7fe640 1 -- 172.21.15.17:0/4068226153 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5364097d00 con 0x7f53740a61c0 2024-04-17T02:22:31.686 INFO:teuthology.orchestra.run.smithi017.stdout:38654705670 2024-04-17T02:22:31.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.685+0000 7f0c24806640 1 -- 172.21.15.17:0/720576100 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f0c200a6140 con 0x7f0c20142c90 2024-04-17T02:22:31.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.686+0000 7f0c16ffd640 1 -- 172.21.15.17:0/720576100 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0c201dab50 con 0x7f0c20142c90 2024-04-17T02:22:31.686 INFO:teuthology.orchestra.run.smithi017.stdout:38654705671 2024-04-17T02:22:31.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.687+0000 7f53796ed640 10 mgrc shutdown 2024-04-17T02:22:31.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.687+0000 7f53796ed640 1 -- 172.21.15.17:0/4068226153 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f535409f400 msgr2=0x7f53540a18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.687+0000 7f53796ed640 1 --2- 172.21.15.17:0/4068226153 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f535409f400 0x7f53540a18c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f536c037000 tx=0x7f536c032000 comp rx=0 tx=0).stop 2024-04-17T02:22:31.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.687+0000 7f53796ed640 1 -- 172.21.15.17:0/4068226153 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f53740a61c0 msgr2=0x7f53740a21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.687+0000 7f53796ed640 1 --2- 172.21.15.17:0/4068226153 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f53740a61c0 0x7f53740a21b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f536400e960 tx=0x7f536400ee20 comp rx=0 tx=0).stop 2024-04-17T02:22:31.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.687+0000 7f53796ed640 1 -- 172.21.15.17:0/4068226153 shutdown_connections 2024-04-17T02:22:31.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.687+0000 7f53796ed640 1 --2- 172.21.15.17:0/4068226153 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f535409f400 0x7f53540a18c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.687+0000 7f53796ed640 1 --2- 172.21.15.17:0/4068226153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5374071ae0 0x7f53740a3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.687+0000 7f53796ed640 1 --2- 172.21.15.17:0/4068226153 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f53740a61c0 0x7f53740a21b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.687+0000 7f53796ed640 1 --2- 172.21.15.17:0/4068226153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5374071350 0x7f5374144f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.687+0000 7f53796ed640 1 -- 172.21.15.17:0/4068226153 >> 172.21.15.17:0/4068226153 conn(0x7f53740743e0 msgr2=0x7f53740722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:31.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.687+0000 7f53796ed640 1 -- 172.21.15.17:0/4068226153 shutdown_connections 2024-04-17T02:22:31.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.687+0000 7f53796ed640 1 -- 172.21.15.17:0/4068226153 wait complete. 2024-04-17T02:22:31.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.688+0000 7f0c24806640 10 mgrc shutdown 2024-04-17T02:22:31.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.688+0000 7f0c24806640 1 -- 172.21.15.17:0/720576100 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f0c0009f530 msgr2=0x7f0c000a19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.688+0000 7f0c24806640 1 --2- 172.21.15.17:0/720576100 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f0c0009f530 0x7f0c000a19f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0c10009bd0 tx=0x7f0c10030000 comp rx=0 tx=0).stop 2024-04-17T02:22:31.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.688+0000 7f0c24806640 1 -- 172.21.15.17:0/720576100 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f0c20142c90 msgr2=0x7f0c2013d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.688+0000 7f0c24806640 1 --2- 172.21.15.17:0/720576100 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f0c20142c90 0x7f0c2013d5c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0c1800d460 tx=0x7f0c1800d920 comp rx=0 tx=0).stop 2024-04-17T02:22:31.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.688+0000 7f0c24806640 1 -- 172.21.15.17:0/720576100 shutdown_connections 2024-04-17T02:22:31.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.688+0000 7f0c24806640 1 --2- 172.21.15.17:0/720576100 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f0c0009f530 0x7f0c000a19f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.688+0000 7f0c24806640 1 --2- 172.21.15.17:0/720576100 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f0c20142c90 0x7f0c2013d5c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.688+0000 7f0c24806640 1 --2- 172.21.15.17:0/720576100 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c200bb460 0x7f0c20148cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.688+0000 7f0c24806640 1 --2- 172.21.15.17:0/720576100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c200ab5b0 0x7f0c201db010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.688+0000 7f0c24806640 1 -- 172.21.15.17:0/720576100 >> 172.21.15.17:0/720576100 conn(0x7f0c200ba940 msgr2=0x7f0c2013f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:31.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.688+0000 7f0c24806640 1 -- 172.21.15.17:0/720576100 shutdown_connections 2024-04-17T02:22:31.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.688+0000 7f0c24806640 1 -- 172.21.15.17:0/720576100 wait complete. 2024-04-17T02:22:31.704 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705670 for osd.2 2024-04-17T02:22:31.705 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705671 for osd.1 2024-04-17T02:22:31.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.715+0000 7f9a58320640 1 -- 172.21.15.17:0/3514851113 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f9a38005640 con 0x7f9a5014cd70 2024-04-17T02:22:31.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.716+0000 7f9a46ffd640 1 -- 172.21.15.17:0/3514851113 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9a500a8900 con 0x7f9a5014cd70 2024-04-17T02:22:31.717 INFO:teuthology.orchestra.run.smithi017.stdout:38654705671 2024-04-17T02:22:31.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.718+0000 7f9a58320640 10 mgrc shutdown 2024-04-17T02:22:31.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.718+0000 7f9a58320640 1 -- 172.21.15.17:0/3514851113 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f9a3409f550 msgr2=0x7f9a340a1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.718+0000 7f9a58320640 1 --2- 172.21.15.17:0/3514851113 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f9a3409f550 0x7f9a340a1a10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c000f60 tx=0x7f9a4c001ac0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.718+0000 7f9a58320640 1 -- 172.21.15.17:0/3514851113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a5014cd70 msgr2=0x7f9a50070ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.718+0000 7f9a58320640 1 --2- 172.21.15.17:0/3514851113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a5014cd70 0x7f9a50070ad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9a4000c6d0 tx=0x7f9a4000cb90 comp rx=0 tx=0).stop 2024-04-17T02:22:31.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.718+0000 7f9a58320640 1 -- 172.21.15.17:0/3514851113 shutdown_connections 2024-04-17T02:22:31.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.718+0000 7f9a58320640 1 --2- 172.21.15.17:0/3514851113 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f9a3409f550 0x7f9a340a1a10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.718+0000 7f9a58320640 1 --2- 172.21.15.17:0/3514851113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a5014cd70 0x7f9a50070ad0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.718+0000 7f9a58320640 1 --2- 172.21.15.17:0/3514851113 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9a50152e30 0x7f9a50071010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.718+0000 7f9a58320640 1 --2- 172.21.15.17:0/3514851113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a500a9580 0x7f9a50071930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.718+0000 7f9a58320640 1 -- 172.21.15.17:0/3514851113 >> 172.21.15.17:0/3514851113 conn(0x7f9a500ba940 msgr2=0x7f9a501492c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:31.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.718+0000 7f9a58320640 1 -- 172.21.15.17:0/3514851113 shutdown_connections 2024-04-17T02:22:31.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.718+0000 7f9a58320640 1 -- 172.21.15.17:0/3514851113 wait complete. 2024-04-17T02:22:31.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.723+0000 7f529cff9640 1 -- 172.21.15.17:0/3249156840 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f52a8141330 con 0x7f52a80ab5b0 2024-04-17T02:22:31.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.724+0000 7f529effd640 1 -- 172.21.15.17:0/3249156840 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5298017020 con 0x7f52a80ab5b0 2024-04-17T02:22:31.725 INFO:teuthology.orchestra.run.smithi017.stdout:38654705671 2024-04-17T02:22:31.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.726+0000 7f529cff9640 10 mgrc shutdown 2024-04-17T02:22:31.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.726+0000 7f529cff9640 1 -- 172.21.15.17:0/3249156840 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f528809f5d0 msgr2=0x7f52880a1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.726+0000 7f529cff9640 1 --2- 172.21.15.17:0/3249156840 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f528809f5d0 0x7f52880a1a90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f52a81dbe30 tx=0x7f5290009040 comp rx=0 tx=0).stop 2024-04-17T02:22:31.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.726+0000 7f529cff9640 1 -- 172.21.15.17:0/3249156840 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f52a80ab5b0 msgr2=0x7f52a813cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:31.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.726+0000 7f529cff9640 1 --2- 172.21.15.17:0/3249156840 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f52a80ab5b0 0x7f52a813cee0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f529800e810 tx=0x7f529800ecd0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.726+0000 7f529cff9640 1 -- 172.21.15.17:0/3249156840 shutdown_connections 2024-04-17T02:22:31.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.726+0000 7f529cff9640 1 --2- 172.21.15.17:0/3249156840 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f528809f5d0 0x7f52880a1a90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.726+0000 7f529cff9640 1 --2- 172.21.15.17:0/3249156840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52a80bb460 0x7f52a8146560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.726+0000 7f529cff9640 1 --2- 172.21.15.17:0/3249156840 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52a8142c90 0x7f52a81d9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.726+0000 7f529cff9640 1 --2- 172.21.15.17:0/3249156840 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f52a80ab5b0 0x7f52a813cee0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:31.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.726+0000 7f529cff9640 1 -- 172.21.15.17:0/3249156840 >> 172.21.15.17:0/3249156840 conn(0x7f52a80ba940 msgr2=0x7f52a80a8610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:31.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.726+0000 7f529cff9640 1 -- 172.21.15.17:0/3249156840 shutdown_connections 2024-04-17T02:22:31.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:31.726+0000 7f529cff9640 1 -- 172.21.15.17:0/3249156840 wait complete. 2024-04-17T02:22:31.730 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705671 for osd.3 2024-04-17T02:22:31.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705671 for osd.0 2024-04-17T02:22:32.705 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-17T02:22:32.705 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-17T02:22:32.731 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-17T02:22:32.739 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-17T02:22:32.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.825+0000 7f4283619640 1 Processor -- start 2024-04-17T02:22:32.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.825+0000 7f4512445640 1 Processor -- start 2024-04-17T02:22:32.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.825+0000 7f4512445640 1 -- start start 2024-04-17T02:22:32.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.826+0000 7f4283619640 1 -- start start 2024-04-17T02:22:32.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.826+0000 7f4512445640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f450c0674b0 0x7f450c0a7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:32.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.826+0000 7f4512445640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f450c0a4560 0x7f450c14cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:32.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.826+0000 7f4512445640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f450c0a91d0 con 0x7f450c0a81b0 2024-04-17T02:22:32.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.826+0000 7f4512445640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f450c067890 con 0x7f450c0674b0 2024-04-17T02:22:32.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.826+0000 7f4512445640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f450c0a9470 con 0x7f450c0a4560 2024-04-17T02:22:32.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.826+0000 7f450bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f450c0674b0 0x7f450c0a7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:32.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.826+0000 7f4503fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f450c0a81b0 0x7f450c0a3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42022/0 (socket says 172.21.15.17:42022) 2024-04-17T02:22:32.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.826+0000 7f4503fff640 1 -- 172.21.15.17:0/2038770168 learned_addr learned my addr 172.21.15.17:0/2038770168 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:22:32.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.827+0000 7f4283619640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f427c0733d0 0x7f427c0a5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:32.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.827+0000 7f4283619640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f427c0a60e0 0x7f427c14d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:32.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.827+0000 7f4283619640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f427c0a8f30 con 0x7f427c143a20 2024-04-17T02:22:32.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.827+0000 7f45109e2640 1 --2- 172.21.15.17:0/2038770168 >> v2:172.21.15.122:3300/0 conn(0x7f450c0a4560 0x7f450c14cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:32.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.827+0000 7f4283619640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f427c0a7360 con 0x7f427c0a60e0 2024-04-17T02:22:32.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.827+0000 7f4283619640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f427c0a7620 con 0x7f427c0733d0 2024-04-17T02:22:32.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.827+0000 7f42813b5640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f427c143a20 0x7f427c0a8260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42030/0 (socket says 172.21.15.17:42030) 2024-04-17T02:22:32.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.827+0000 7f42813b5640 1 -- 172.21.15.17:0/529174676 learned_addr learned my addr 172.21.15.17:0/529174676 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:22:32.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.827+0000 7f450bfff640 1 -- 172.21.15.17:0/2038770168 >> v2:172.21.15.122:3300/0 conn(0x7f450c0a4560 msgr2=0x7f450c14cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:32.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.827+0000 7f4280bb4640 1 --2- 172.21.15.17:0/529174676 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f427c0733d0 0x7f427c0a5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:32.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.827+0000 7f4281bb6640 1 --2- 172.21.15.17:0/529174676 >> v2:172.21.15.17:3300/0 conn(0x7f427c0a60e0 0x7f427c14d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:32.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.827+0000 7f450bfff640 1 --2- 172.21.15.17:0/2038770168 >> v2:172.21.15.122:3300/0 conn(0x7f450c0a4560 0x7f450c14cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:32.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.827+0000 7f450bfff640 1 -- 172.21.15.17:0/2038770168 >> v1:172.21.15.17:6789/0 conn(0x7f450c0a81b0 legacy=0x7f450c0a3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:32.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.827+0000 7f450bfff640 1 -- 172.21.15.17:0/2038770168 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f450c0a0ba0 con 0x7f450c0674b0 2024-04-17T02:22:32.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.827+0000 7f4273fff640 1 -- 172.21.15.17:0/529174676 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3381751916 0 0) 0x7f427c0a8f30 con 0x7f427c143a20 2024-04-17T02:22:32.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.827+0000 7f4273fff640 1 -- 172.21.15.17:0/529174676 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4268003520 con 0x7f427c143a20 2024-04-17T02:22:32.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.827+0000 7f4280bb4640 1 -- 172.21.15.17:0/529174676 >> v2:172.21.15.17:3300/0 conn(0x7f427c0a60e0 msgr2=0x7f427c14d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:32.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.827+0000 7f4280bb4640 1 --2- 172.21.15.17:0/529174676 >> v2:172.21.15.17:3300/0 conn(0x7f427c0a60e0 0x7f427c14d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:32.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.827+0000 7f4280bb4640 1 -- 172.21.15.17:0/529174676 >> v1:172.21.15.17:6789/0 conn(0x7f427c143a20 legacy=0x7f427c0a8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:32.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.827+0000 7f4280bb4640 1 -- 172.21.15.17:0/529174676 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f427c0a7080 con 0x7f427c0733d0 2024-04-17T02:22:32.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.827+0000 7f4281bb6640 1 --2- 172.21.15.17:0/529174676 >> v2:172.21.15.17:3300/0 conn(0x7f427c0a60e0 0x7f427c14d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T02:22:32.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.828+0000 7f450bfff640 1 --2- 172.21.15.17:0/2038770168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f450c0674b0 0x7f450c0a7c70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f450c0a3bc0 tx=0x7f44fc02b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=765244ee4d0fba0e server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:32.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.828+0000 7f4280bb4640 1 --2- 172.21.15.17:0/529174676 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f427c0733d0 0x7f427c0a5ba0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f426c0097a0 tx=0x7f426c02b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d0ade6ff4f7fbd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:32.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.828+0000 7f4273fff640 1 -- 172.21.15.17:0/529174676 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426c039070 con 0x7f427c0733d0 2024-04-17T02:22:32.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.828+0000 7f4273fff640 1 -- 172.21.15.17:0/529174676 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f426c0316f0 con 0x7f427c0733d0 2024-04-17T02:22:32.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.828+0000 7f4273fff640 1 -- 172.21.15.17:0/529174676 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426c031ac0 con 0x7f427c0733d0 2024-04-17T02:22:32.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.828+0000 7f450b7fe640 1 -- 172.21.15.17:0/2038770168 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44fc037070 con 0x7f450c0674b0 2024-04-17T02:22:32.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.828+0000 7f450b7fe640 1 -- 172.21.15.17:0/2038770168 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44fc030510 con 0x7f450c0674b0 2024-04-17T02:22:32.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.828+0000 7f450b7fe640 1 -- 172.21.15.17:0/2038770168 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44fc0308e0 con 0x7f450c0674b0 2024-04-17T02:22:32.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.829+0000 7f4512445640 1 -- 172.21.15.17:0/2038770168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f450c0674b0 msgr2=0x7f450c0a7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:32.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.829+0000 7f4512445640 1 --2- 172.21.15.17:0/2038770168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f450c0674b0 0x7f450c0a7c70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f450c0a3bc0 tx=0x7f44fc02b600 comp rx=0 tx=0).stop 2024-04-17T02:22:32.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.829+0000 7f4512445640 1 -- 172.21.15.17:0/2038770168 shutdown_connections 2024-04-17T02:22:32.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.829+0000 7f4512445640 1 --2- 172.21.15.17:0/2038770168 >> v2:172.21.15.122:3300/0 conn(0x7f450c0a4560 0x7f450c14cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:32.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.829+0000 7f4512445640 1 --2- 172.21.15.17:0/2038770168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f450c0674b0 0x7f450c0a7c70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:32.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.829+0000 7f4512445640 1 -- 172.21.15.17:0/2038770168 >> 172.21.15.17:0/2038770168 conn(0x7f450c0a6680 msgr2=0x7f450c0b6ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:32.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.829+0000 7f4512445640 1 -- 172.21.15.17:0/2038770168 shutdown_connections 2024-04-17T02:22:32.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.829+0000 7f4512445640 1 -- 172.21.15.17:0/2038770168 wait complete. 2024-04-17T02:22:32.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.829+0000 7f4283619640 1 -- 172.21.15.17:0/529174676 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f427c0733d0 msgr2=0x7f427c0a5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:32.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.829+0000 7f4283619640 1 --2- 172.21.15.17:0/529174676 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f427c0733d0 0x7f427c0a5ba0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f426c0097a0 tx=0x7f426c02b790 comp rx=0 tx=0).stop 2024-04-17T02:22:32.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.829+0000 7f4283619640 1 -- 172.21.15.17:0/529174676 shutdown_connections 2024-04-17T02:22:32.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.829+0000 7f4283619640 1 --2- 172.21.15.17:0/529174676 >> v2:172.21.15.17:3300/0 conn(0x7f427c0a60e0 0x7f427c14d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:32.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.829+0000 7f4283619640 1 --2- 172.21.15.17:0/529174676 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f427c0733d0 0x7f427c0a5ba0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:32.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.830+0000 7f4283619640 1 -- 172.21.15.17:0/529174676 >> 172.21.15.17:0/529174676 conn(0x7f427c0746a0 msgr2=0x7f427c0a7ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:32.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.830+0000 7f4283619640 1 -- 172.21.15.17:0/529174676 shutdown_connections 2024-04-17T02:22:32.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.830+0000 7f4283619640 1 -- 172.21.15.17:0/529174676 wait complete. 2024-04-17T02:22:32.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.830+0000 7f4512445640 1 Processor -- start 2024-04-17T02:22:32.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.831+0000 7f4512445640 1 -- start start 2024-04-17T02:22:32.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.831+0000 7f4283619640 1 Processor -- start 2024-04-17T02:22:32.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.831+0000 7f4512445640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f450c0674b0 0x7f450c071d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:32.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.831+0000 7f4283619640 1 -- start start 2024-04-17T02:22:32.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.831+0000 7f4512445640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f450c0a4560 0x7f450c1ddd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:32.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.831+0000 7f450bfff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f450c0674b0 0x7f450c071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:32.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.831+0000 7f4512445640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f450c0a81b0 0x7f450c1de2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:32.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.831+0000 7f450bfff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f450c0674b0 0x7f450c071d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:53052/0 (socket says 172.21.15.17:53052) 2024-04-17T02:22:32.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.831+0000 7f4512445640 1 -- 172.21.15.17:0/203554631 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f450c0a7a00 con 0x7f450c0a4560 2024-04-17T02:22:32.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.831+0000 7f4512445640 1 -- 172.21.15.17:0/203554631 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f450c0a7880 con 0x7f450c0a81b0 2024-04-17T02:22:32.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.832+0000 7f4512445640 1 -- 172.21.15.17:0/203554631 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f450c09fdc0 con 0x7f450c0674b0 2024-04-17T02:22:32.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.832+0000 7f450bfff640 1 -- 172.21.15.17:0/203554631 learned_addr learned my addr 172.21.15.17:0/203554631 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:32.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.832+0000 7f4503fff640 1 --2- 172.21.15.17:0/203554631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f450c0a4560 0x7f450c1ddd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:32.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.832+0000 7f45109e2640 1 --2- 172.21.15.17:0/203554631 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f450c0a81b0 0x7f450c1de2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:32.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.832+0000 7f4503fff640 1 -- 172.21.15.17:0/203554631 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f450c0674b0 msgr2=0x7f450c071d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:32.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.832+0000 7f4503fff640 1 --2- 172.21.15.17:0/203554631 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f450c0674b0 0x7f450c071d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:32.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.832+0000 7f4503fff640 1 -- 172.21.15.17:0/203554631 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f450c0a81b0 msgr2=0x7f450c1de2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:32.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.832+0000 7f4503fff640 1 --2- 172.21.15.17:0/203554631 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f450c0a81b0 0x7f450c1de2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:32.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.832+0000 7f4503fff640 1 -- 172.21.15.17:0/203554631 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f450c1dea10 con 0x7f450c0a4560 2024-04-17T02:22:32.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.832+0000 7f4283619640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f427c0733d0 0x7f427c0b77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:32.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.832+0000 7f4283619640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f427c0a60e0 0x7f427c0a4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:32.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.832+0000 7f4283619640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f427c143a20 0x7f427c0b85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:32.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.832+0000 7f42813b5640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f427c0733d0 0x7f427c0b77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:32.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.832+0000 7f42813b5640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f427c0733d0 0x7f427c0b77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:53056/0 (socket says 172.21.15.17:53056) 2024-04-17T02:22:32.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.832+0000 7f42813b5640 1 -- 172.21.15.17:0/1575314825 learned_addr learned my addr 172.21.15.17:0/1575314825 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:32.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.832+0000 7f4280bb4640 1 --2- 172.21.15.17:0/1575314825 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f427c0a60e0 0x7f427c0a4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:32.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.832+0000 7f4283619640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f427c072c70 con 0x7f427c143a20 2024-04-17T02:22:32.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.832+0000 7f4283619640 1 -- 172.21.15.17:0/1575314825 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f427c072af0 con 0x7f427c0a60e0 2024-04-17T02:22:32.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.832+0000 7f4503fff640 1 --2- 172.21.15.17:0/203554631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f450c0a4560 0x7f450c1ddd80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f44f400c500 tx=0x7f44f400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:32.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.832+0000 7f4283619640 1 -- 172.21.15.17:0/1575314825 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f427c0aaf00 con 0x7f427c0733d0 2024-04-17T02:22:32.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.832+0000 7f45097fa640 1 -- 172.21.15.17:0/203554631 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f4018070 con 0x7f450c0a4560 2024-04-17T02:22:32.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.832+0000 7f45097fa640 1 -- 172.21.15.17:0/203554631 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44f4007560 con 0x7f450c0a4560 2024-04-17T02:22:32.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.832+0000 7f45097fa640 1 -- 172.21.15.17:0/203554631 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f40049e0 con 0x7f450c0a4560 2024-04-17T02:22:32.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.833+0000 7f4512445640 1 -- 172.21.15.17:0/203554631 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f450c072930 con 0x7f450c0a4560 2024-04-17T02:22:32.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.833+0000 7f4281bb6640 1 --2- 172.21.15.17:0/1575314825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f427c143a20 0x7f427c0b85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:32.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.833+0000 7f4512445640 1 -- 172.21.15.17:0/203554631 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f450c0ab8b0 con 0x7f450c0a4560 2024-04-17T02:22:32.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.833+0000 7f42813b5640 1 -- 172.21.15.17:0/1575314825 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f427c0a60e0 msgr2=0x7f427c0a4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:32.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.833+0000 7f42813b5640 1 --2- 172.21.15.17:0/1575314825 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f427c0a60e0 0x7f427c0a4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:32.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.833+0000 7f42813b5640 1 -- 172.21.15.17:0/1575314825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f427c143a20 msgr2=0x7f427c0b85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:32.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.833+0000 7f42813b5640 1 --2- 172.21.15.17:0/1575314825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f427c143a20 0x7f427c0b85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:32.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.833+0000 7f42813b5640 1 -- 172.21.15.17:0/1575314825 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f427c0b7e90 con 0x7f427c0733d0 2024-04-17T02:22:32.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.833+0000 7f42813b5640 1 --2- 172.21.15.17:0/1575314825 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f427c0733d0 0x7f427c0b77d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f427800c3c0 tx=0x7f427800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:32.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.834+0000 7f4271ffb640 1 -- 172.21.15.17:0/1575314825 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4278017070 con 0x7f427c0733d0 2024-04-17T02:22:32.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.834+0000 7f4271ffb640 1 -- 172.21.15.17:0/1575314825 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4278005ce0 con 0x7f427c0733d0 2024-04-17T02:22:32.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.834+0000 7f4271ffb640 1 -- 172.21.15.17:0/1575314825 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42780072f0 con 0x7f427c0733d0 2024-04-17T02:22:32.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.834+0000 7f4283619640 1 -- 172.21.15.17:0/1575314825 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f427c0b8130 con 0x7f427c0733d0 2024-04-17T02:22:32.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.834+0000 7f4283619640 1 -- 172.21.15.17:0/1575314825 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f427c0a3eb0 con 0x7f427c0733d0 2024-04-17T02:22:32.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.834+0000 7f4512445640 1 -- 172.21.15.17:0/203554631 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f450c067f80 con 0x7f450c0a4560 2024-04-17T02:22:32.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.836+0000 7f4283619640 1 -- 172.21.15.17:0/1575314825 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f427c067f80 con 0x7f427c0733d0 2024-04-17T02:22:32.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.836+0000 7f45097fa640 1 -- 172.21.15.17:0/203554631 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f44f401b070 con 0x7f450c0a4560 2024-04-17T02:22:32.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.836+0000 7f45097fa640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:32.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.836+0000 7f45097fa640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:32.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.836+0000 7f45097fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:32.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.836+0000 7f45097fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:32.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.836+0000 7f45097fa640 1 --2- 172.21.15.17:0/203554631 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f44ec09f4b0 0x7f44ec0a1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:32.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.837+0000 7f45097fa640 1 -- 172.21.15.17:0/203554631 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f44f40c8690 con 0x7f450c0a4560 2024-04-17T02:22:32.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.837+0000 7f450bfff640 1 --2- 172.21.15.17:0/203554631 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f44ec09f4b0 0x7f44ec0a1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:32.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.837+0000 7f4271ffb640 1 -- 172.21.15.17:0/1575314825 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f427801a070 con 0x7f427c0733d0 2024-04-17T02:22:32.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.837+0000 7f4271ffb640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:32.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.837+0000 7f450bfff640 1 --2- 172.21.15.17:0/203554631 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f44ec09f4b0 0x7f44ec0a1970 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f44fc009560 tx=0x7f44fc008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:32.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.837+0000 7f4271ffb640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:32.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.837+0000 7f4271ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:32.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.837+0000 7f4271ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:32.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.837+0000 7f4271ffb640 1 --2- 172.21.15.17:0/1575314825 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f426009f550 0x7f42600a1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:32.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.838+0000 7f4280bb4640 1 --2- 172.21.15.17:0/1575314825 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f426009f550 0x7f42600a1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:32.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.838+0000 7f4271ffb640 1 -- 172.21.15.17:0/1575314825 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f42780c87d0 con 0x7f427c0733d0 2024-04-17T02:22:32.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.838+0000 7f4280bb4640 1 --2- 172.21.15.17:0/1575314825 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f426009f550 0x7f42600a1a10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f426c036000 tx=0x7f426c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:32.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.846+0000 7f45097fa640 1 -- 172.21.15.17:0/203554631 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f44f404ee10 con 0x7f450c0a4560 2024-04-17T02:22:32.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.847+0000 7f4271ffb640 1 -- 172.21.15.17:0/1575314825 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f42780971e0 con 0x7f427c0733d0 2024-04-17T02:22:32.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.868+0000 7fd0ec686640 1 Processor -- start 2024-04-17T02:22:32.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.868+0000 7fd0ec686640 1 -- start start 2024-04-17T02:22:32.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.868+0000 7fd0ec686640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd0e414cd70 0x7fd0e40a9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:32.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.869+0000 7fd0ec686640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0e40ab470 con 0x7fd0e40a81f0 2024-04-17T02:22:32.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.869+0000 7fd0ec686640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0e40a7ae0 con 0x7fd0e40a8660 2024-04-17T02:22:32.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.869+0000 7fd0ec686640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fd0e40a7da0 con 0x7fd0e414cd70 2024-04-17T02:22:32.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.869+0000 7fd0e9c21640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fd0e40a81f0 0x7fd0e414d150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42042/0 (socket says 172.21.15.17:42042) 2024-04-17T02:22:32.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.869+0000 7fd0e9c21640 1 -- 172.21.15.17:0/3485517401 learned_addr learned my addr 172.21.15.17:0/3485517401 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:22:32.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.869+0000 7fd0ea422640 1 --2- 172.21.15.17:0/3485517401 >> v2:172.21.15.17:3300/0 conn(0x7fd0e414cd70 0x7fd0e40a9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:32.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.869+0000 7fd0e9420640 1 -- 172.21.15.17:0/3485517401 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 226711499 0 0) 0x7fd0d4001110 con 0x7fd0e40a81f0 2024-04-17T02:22:32.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.869+0000 7fd0e9420640 1 -- 172.21.15.17:0/3485517401 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0d0003520 con 0x7fd0e40a81f0 2024-04-17T02:22:32.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.869+0000 7fd0e9420640 1 -- 172.21.15.17:0/3485517401 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3856222296 0 0) 0x7fd0e40a7ae0 con 0x7fd0e40a8660 2024-04-17T02:22:32.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.869+0000 7fd0e9420640 1 -- 172.21.15.17:0/3485517401 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0d4001110 con 0x7fd0e40a8660 2024-04-17T02:22:32.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.869+0000 7fd0ea422640 1 -- 172.21.15.17:0/3485517401 >> v1:172.21.15.122:6789/0 conn(0x7fd0e40a8660 legacy=0x7fd0e4153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:32.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.869+0000 7fd0ea422640 1 -- 172.21.15.17:0/3485517401 >> v1:172.21.15.17:6789/0 conn(0x7fd0e40a81f0 legacy=0x7fd0e414d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:32.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.869+0000 7fd0ea422640 1 -- 172.21.15.17:0/3485517401 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e40bb460 con 0x7fd0e414cd70 2024-04-17T02:22:32.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.871+0000 7fd0ea422640 1 --2- 172.21.15.17:0/3485517401 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0e414cd70 0x7fd0e40a9580 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd0e00097a0 tx=0x7fd0e002b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e5eb8fa405c19 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:32.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.871+0000 7fd0e9420640 1 -- 172.21.15.17:0/3485517401 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0037070 con 0x7fd0e414cd70 2024-04-17T02:22:32.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.871+0000 7fd0e9420640 1 -- 172.21.15.17:0/3485517401 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0e0030510 con 0x7fd0e414cd70 2024-04-17T02:22:32.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.871+0000 7fd0e9420640 1 -- 172.21.15.17:0/3485517401 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4001840 con 0x7fd0e414cd70 2024-04-17T02:22:32.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.872+0000 7fd0ec686640 1 -- 172.21.15.17:0/3485517401 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0e414cd70 msgr2=0x7fd0e40a9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:32.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.872+0000 7fd0ec686640 1 --2- 172.21.15.17:0/3485517401 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0e414cd70 0x7fd0e40a9580 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd0e00097a0 tx=0x7fd0e002b6b0 comp rx=0 tx=0).stop 2024-04-17T02:22:32.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.872+0000 7fd0ec686640 1 -- 172.21.15.17:0/3485517401 shutdown_connections 2024-04-17T02:22:32.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.872+0000 7fd0ec686640 1 --2- 172.21.15.17:0/3485517401 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0e414cd70 0x7fd0e40a9580 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:32.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.872+0000 7fd0ec686640 1 -- 172.21.15.17:0/3485517401 >> 172.21.15.17:0/3485517401 conn(0x7fd0e40ba940 msgr2=0x7fd0e40bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:32.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.872+0000 7fd0ec686640 1 -- 172.21.15.17:0/3485517401 shutdown_connections 2024-04-17T02:22:32.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.872+0000 7fd0ec686640 1 -- 172.21.15.17:0/3485517401 wait complete. 2024-04-17T02:22:32.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.873+0000 7fd0ec686640 1 Processor -- start 2024-04-17T02:22:32.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.873+0000 7fd0ec686640 1 -- start start 2024-04-17T02:22:32.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.874+0000 7fd0ec686640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd0e40a81f0 0x7fd0e4071c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:32.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.874+0000 7fd0ec686640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0e40a8660 0x7fd0e4145190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:32.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.874+0000 7fd0ec686640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0e414cd70 0x7fd0e413b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:32.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.874+0000 7fd0ec686640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e414d9e0 con 0x7fd0e40a8660 2024-04-17T02:22:32.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.874+0000 7fd0ec686640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e414d860 con 0x7fd0e414cd70 2024-04-17T02:22:32.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.874+0000 7fd0ec686640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fd0e4155550 con 0x7fd0e40a81f0 2024-04-17T02:22:32.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.874+0000 7fd0ea422640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd0e40a81f0 0x7fd0e4071c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:32.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.874+0000 7fd0ea422640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd0e40a81f0 0x7fd0e4071c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:53072/0 (socket says 172.21.15.17:53072) 2024-04-17T02:22:32.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.874+0000 7fd0e9c21640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0e40a8660 0x7fd0e4145190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:32.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.874+0000 7fd0ea422640 1 -- 172.21.15.17:0/1094706796 learned_addr learned my addr 172.21.15.17:0/1094706796 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:32.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.874+0000 7fd0eac23640 1 --2- 172.21.15.17:0/1094706796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0e414cd70 0x7fd0e413b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:32.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.874+0000 7fd0eac23640 1 -- 172.21.15.17:0/1094706796 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd0e40a81f0 msgr2=0x7fd0e4071c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:32.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.874+0000 7fd0eac23640 1 --2- 172.21.15.17:0/1094706796 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd0e40a81f0 0x7fd0e4071c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:32.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.874+0000 7fd0eac23640 1 -- 172.21.15.17:0/1094706796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0e40a8660 msgr2=0x7fd0e4145190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:32.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.874+0000 7fd0eac23640 1 --2- 172.21.15.17:0/1094706796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0e40a8660 0x7fd0e4145190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:32.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.874+0000 7fd0eac23640 1 -- 172.21.15.17:0/1094706796 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e406e740 con 0x7fd0e414cd70 2024-04-17T02:22:32.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.874+0000 7fd0e9c21640 1 --2- 172.21.15.17:0/1094706796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0e40a8660 0x7fd0e4145190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:32.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.875+0000 7fd0eac23640 1 --2- 172.21.15.17:0/1094706796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0e414cd70 0x7fd0e413b050 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd0e406d480 tx=0x7fd0dc00cb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:32.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.875+0000 7fd0daffd640 1 -- 172.21.15.17:0/1094706796 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc003b70 con 0x7fd0e414cd70 2024-04-17T02:22:32.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.875+0000 7fd0daffd640 1 -- 172.21.15.17:0/1094706796 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0dc003d30 con 0x7fd0e414cd70 2024-04-17T02:22:32.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.875+0000 7fd0daffd640 1 -- 172.21.15.17:0/1094706796 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc005310 con 0x7fd0e414cd70 2024-04-17T02:22:32.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.875+0000 7fd0ec686640 1 -- 172.21.15.17:0/1094706796 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0e406ea00 con 0x7fd0e414cd70 2024-04-17T02:22:32.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.875+0000 7fd0ec686640 1 -- 172.21.15.17:0/1094706796 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0e406e3e0 con 0x7fd0e414cd70 2024-04-17T02:22:32.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.876+0000 7feead38f640 1 Processor -- start 2024-04-17T02:22:32.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.876+0000 7feead38f640 1 -- start start 2024-04-17T02:22:32.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.876+0000 7fd0ec686640 1 -- 172.21.15.17:0/1094706796 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0e40687f0 con 0x7fd0e414cd70 2024-04-17T02:22:32.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.877+0000 7feead38f640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7feea8140de0 0x7feea80a7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:32.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.877+0000 7feead38f640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7feea80a7b70 0x7feea8144950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:32.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.877+0000 7fee9ffff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7feea80a7b70 0x7feea8144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:32.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.877+0000 7feea6ffd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7feea8140de0 0x7feea80a7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:32.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.877+0000 7fee9ffff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7feea80a7b70 0x7feea8144950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:53088/0 (socket says 172.21.15.17:53088) 2024-04-17T02:22:32.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.877+0000 7fee9ffff640 1 -- 172.21.15.17:0/1985026840 learned_addr learned my addr 172.21.15.17:0/1985026840 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:32.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.877+0000 7feead38f640 1 --2- 172.21.15.17:0/1985026840 >> v2:172.21.15.17:3300/0 conn(0x7feea8144e90 0x7feea81411c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:32.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.877+0000 7feead38f640 1 -- 172.21.15.17:0/1985026840 --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7feea80a8f40 con 0x7feea8144e90 2024-04-17T02:22:32.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.877+0000 7feead38f640 1 -- 172.21.15.17:0/1985026840 --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7feea81453b0 con 0x7feea8140de0 2024-04-17T02:22:32.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.877+0000 7feead38f640 1 -- 172.21.15.17:0/1985026840 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7feea8145670 con 0x7feea80a7b70 2024-04-17T02:22:32.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.877+0000 7feea77fe640 1 --2- 172.21.15.17:0/1985026840 >> v2:172.21.15.17:3300/0 conn(0x7feea8144e90 0x7feea81411c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:32.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.878+0000 7fee9ffff640 1 -- 172.21.15.17:0/1985026840 >> v2:172.21.15.122:3300/0 conn(0x7feea8140de0 msgr2=0x7feea80a7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:32.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.878+0000 7fd0daffd640 1 -- 172.21.15.17:0/1094706796 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7fd0dc0054b0 con 0x7fd0e414cd70 2024-04-17T02:22:32.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.878+0000 7fd0daffd640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:32.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.878+0000 7fee9ffff640 1 --2- 172.21.15.17:0/1985026840 >> v2:172.21.15.122:3300/0 conn(0x7feea8140de0 0x7feea80a7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:32.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.878+0000 7fee9ffff640 1 -- 172.21.15.17:0/1985026840 >> v2:172.21.15.17:3300/0 conn(0x7feea8144e90 msgr2=0x7feea81411c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:32.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.878+0000 7fee9ffff640 1 --2- 172.21.15.17:0/1985026840 >> v2:172.21.15.17:3300/0 conn(0x7feea8144e90 0x7feea81411c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:32.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.878+0000 7fee9ffff640 1 -- 172.21.15.17:0/1985026840 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feea80a93d0 con 0x7feea80a7b70 2024-04-17T02:22:32.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.878+0000 7fd0daffd640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:32.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.878+0000 7fd0daffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:32.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.878+0000 7fd0daffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:32.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.878+0000 7fd0daffd640 1 --2- 172.21.15.17:0/1094706796 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fd0c809f430 0x7fd0c80a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:32.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.878+0000 7fd0daffd640 1 -- 172.21.15.17:0/1094706796 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7fd0dc0c9cf0 con 0x7fd0e414cd70 2024-04-17T02:22:32.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.879+0000 7fd0ea422640 1 --2- 172.21.15.17:0/1094706796 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fd0c809f430 0x7fd0c80a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:32.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.879+0000 7fee9ffff640 1 --2- 172.21.15.17:0/1985026840 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7feea80a7b70 0x7feea8144950 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7feea80a43e0 tx=0x7fee9002b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b4a6512953b6525 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:32.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.879+0000 7feea67fc640 1 -- 172.21.15.17:0/1985026840 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee9002e070 con 0x7feea80a7b70 2024-04-17T02:22:32.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.879+0000 7fd0ea422640 1 --2- 172.21.15.17:0/1094706796 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fd0c809f430 0x7fd0c80a18f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0009560 tx=0x7fd0e0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:32.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.879+0000 7feea67fc640 1 -- 172.21.15.17:0/1985026840 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee90037070 con 0x7feea80a7b70 2024-04-17T02:22:32.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.879+0000 7feea67fc640 1 -- 172.21.15.17:0/1985026840 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee90031a00 con 0x7feea80a7b70 2024-04-17T02:22:32.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.880+0000 7feead38f640 1 -- 172.21.15.17:0/1985026840 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7feea80a7b70 msgr2=0x7feea8144950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:32.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.880+0000 7feead38f640 1 --2- 172.21.15.17:0/1985026840 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7feea80a7b70 0x7feea8144950 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7feea80a43e0 tx=0x7fee9002b880 comp rx=0 tx=0).stop 2024-04-17T02:22:32.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.880+0000 7feead38f640 1 -- 172.21.15.17:0/1985026840 shutdown_connections 2024-04-17T02:22:32.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.880+0000 7feead38f640 1 --2- 172.21.15.17:0/1985026840 >> v2:172.21.15.17:3300/0 conn(0x7feea8144e90 0x7feea81411c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:32.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.880+0000 7feead38f640 1 --2- 172.21.15.17:0/1985026840 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7feea80a7b70 0x7feea8144950 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:32.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.880+0000 7feead38f640 1 --2- 172.21.15.17:0/1985026840 >> v2:172.21.15.122:3300/0 conn(0x7feea8140de0 0x7feea80a7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:32.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.880+0000 7feead38f640 1 -- 172.21.15.17:0/1985026840 >> 172.21.15.17:0/1985026840 conn(0x7feea80a6150 msgr2=0x7feea80a6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:32.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.880+0000 7feead38f640 1 -- 172.21.15.17:0/1985026840 shutdown_connections 2024-04-17T02:22:32.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.880+0000 7feead38f640 1 -- 172.21.15.17:0/1985026840 wait complete. 2024-04-17T02:22:32.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.882+0000 7fd0daffd640 1 -- 172.21.15.17:0/1094706796 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fd0dc098d50 con 0x7fd0e414cd70 2024-04-17T02:22:32.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.882+0000 7feead38f640 1 Processor -- start 2024-04-17T02:22:32.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.882+0000 7feead38f640 1 -- start start 2024-04-17T02:22:32.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.883+0000 7feead38f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feea80a7b70 0x7feea809a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:32.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.883+0000 7feead38f640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7feea8140de0 0x7feea809b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:32.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.883+0000 7feea6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feea80a7b70 0x7feea809a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:32.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.883+0000 7feea6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feea80a7b70 0x7feea809a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52496/0 (socket says 172.21.15.17:52496) 2024-04-17T02:22:32.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.883+0000 7fee9ffff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7feea8140de0 0x7feea809b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:32.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.883+0000 7fee9ffff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7feea8140de0 0x7feea809b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:53096/0 (socket says 172.21.15.17:53096) 2024-04-17T02:22:32.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.883+0000 7feea6ffd640 1 -- 172.21.15.17:0/3061268362 learned_addr learned my addr 172.21.15.17:0/3061268362 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:32.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.883+0000 7feead38f640 1 --2- 172.21.15.17:0/3061268362 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feea8144e90 0x7feea809bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:32.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.883+0000 7feead38f640 1 -- 172.21.15.17:0/3061268362 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7feea80a89f0 con 0x7feea80a7b70 2024-04-17T02:22:32.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.883+0000 7feead38f640 1 -- 172.21.15.17:0/3061268362 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7feea80a3b80 con 0x7feea8144e90 2024-04-17T02:22:32.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.883+0000 7feead38f640 1 -- 172.21.15.17:0/3061268362 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7feea80a8b70 con 0x7feea8140de0 2024-04-17T02:22:32.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.883+0000 7feea77fe640 1 --2- 172.21.15.17:0/3061268362 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feea8144e90 0x7feea809bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:32.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.883+0000 7feea6ffd640 1 -- 172.21.15.17:0/3061268362 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7feea8140de0 msgr2=0x7feea809b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:32.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.883+0000 7feea6ffd640 1 --2- 172.21.15.17:0/3061268362 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7feea8140de0 0x7feea809b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:32.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.883+0000 7feea6ffd640 1 -- 172.21.15.17:0/3061268362 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feea8144e90 msgr2=0x7feea809bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:32.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.883+0000 7feea6ffd640 1 --2- 172.21.15.17:0/3061268362 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feea8144e90 0x7feea809bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:32.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.883+0000 7feea6ffd640 1 -- 172.21.15.17:0/3061268362 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feea81d5f60 con 0x7feea80a7b70 2024-04-17T02:22:32.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.884+0000 7feea77fe640 1 --2- 172.21.15.17:0/3061268362 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feea8144e90 0x7feea809bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T02:22:32.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.884+0000 7feea6ffd640 1 --2- 172.21.15.17:0/3061268362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feea80a7b70 0x7feea809a4a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fee9800e9e0 tx=0x7fee9800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:32.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.884+0000 7fee9f7fe640 1 -- 172.21.15.17:0/3061268362 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee98017070 con 0x7feea80a7b70 2024-04-17T02:22:32.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.884+0000 7feead38f640 1 -- 172.21.15.17:0/3061268362 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feea809ae00 con 0x7feea80a7b70 2024-04-17T02:22:32.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.884+0000 7fee9f7fe640 1 -- 172.21.15.17:0/3061268362 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee9800c9d0 con 0x7feea80a7b70 2024-04-17T02:22:32.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.884+0000 7fee9f7fe640 1 -- 172.21.15.17:0/3061268362 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee9800cdc0 con 0x7feea80a7b70 2024-04-17T02:22:32.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.884+0000 7feead38f640 1 -- 172.21.15.17:0/3061268362 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feea8071e30 con 0x7feea80a7b70 2024-04-17T02:22:32.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.885+0000 7feead38f640 1 -- 172.21.15.17:0/3061268362 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feea8067f80 con 0x7feea80a7b70 2024-04-17T02:22:32.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.886+0000 7fee9f7fe640 1 -- 172.21.15.17:0/3061268362 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7fee9801a070 con 0x7feea80a7b70 2024-04-17T02:22:32.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.886+0000 7fee9f7fe640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:32.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.887+0000 7fee9f7fe640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:32.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.887+0000 7fee9f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:32.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.887+0000 7fee9f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:32.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.887+0000 7fee9f7fe640 1 --2- 172.21.15.17:0/3061268362 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fee8809f400 0x7fee880a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:32.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.887+0000 7fee9f7fe640 1 -- 172.21.15.17:0/3061268362 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7fee980c9900 con 0x7feea80a7b70 2024-04-17T02:22:32.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.888+0000 7fee9ffff640 1 --2- 172.21.15.17:0/3061268362 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fee8809f400 0x7fee880a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:32.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.888+0000 7fee9ffff640 1 --2- 172.21.15.17:0/3061268362 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fee8809f400 0x7fee880a18c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fee90036000 tx=0x7fee9003d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:32.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:32.896+0000 7fee9f7fe640 1 -- 172.21.15.17:0/3061268362 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fee98098960 con 0x7feea80a7b70 2024-04-17T02:22:33.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.048+0000 7f4283619640 1 -- 172.21.15.17:0/1575314825 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f427c0a5160 con 0x7f427c0733d0 2024-04-17T02:22:33.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.049+0000 7f4271ffb640 1 -- 172.21.15.17:0/1575314825 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f427809b280 con 0x7f427c0733d0 2024-04-17T02:22:33.050 INFO:teuthology.orchestra.run.smithi017.stdout:38654705670 2024-04-17T02:22:33.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.050+0000 7f4283619640 10 mgrc shutdown 2024-04-17T02:22:33.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.051+0000 7f4283619640 1 -- 172.21.15.17:0/1575314825 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f426009f550 msgr2=0x7f42600a1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:33.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.051+0000 7f4283619640 1 --2- 172.21.15.17:0/1575314825 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f426009f550 0x7f42600a1a10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f426c036000 tx=0x7f426c008030 comp rx=0 tx=0).stop 2024-04-17T02:22:33.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.051+0000 7f4283619640 1 -- 172.21.15.17:0/1575314825 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f427c0733d0 msgr2=0x7f427c0b77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:33.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.051+0000 7f4283619640 1 --2- 172.21.15.17:0/1575314825 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f427c0733d0 0x7f427c0b77d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f427800c3c0 tx=0x7f427800c880 comp rx=0 tx=0).stop 2024-04-17T02:22:33.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.051+0000 7f4283619640 1 -- 172.21.15.17:0/1575314825 shutdown_connections 2024-04-17T02:22:33.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.051+0000 7f4283619640 1 --2- 172.21.15.17:0/1575314825 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f426009f550 0x7f42600a1a10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:33.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.051+0000 7f4283619640 1 --2- 172.21.15.17:0/1575314825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f427c143a20 0x7f427c0b85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:33.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.051+0000 7f4283619640 1 --2- 172.21.15.17:0/1575314825 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f427c0a60e0 0x7f427c0a4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:33.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.051+0000 7f4283619640 1 --2- 172.21.15.17:0/1575314825 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f427c0733d0 0x7f427c0b77d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:33.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.051+0000 7f4283619640 1 -- 172.21.15.17:0/1575314825 >> 172.21.15.17:0/1575314825 conn(0x7f427c0746a0 msgr2=0x7f427c0a81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:33.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.051+0000 7f4283619640 1 -- 172.21.15.17:0/1575314825 shutdown_connections 2024-04-17T02:22:33.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.051+0000 7f4283619640 1 -- 172.21.15.17:0/1575314825 wait complete. 2024-04-17T02:22:33.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.053+0000 7f4512445640 1 -- 172.21.15.17:0/203554631 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f450c0a5140 con 0x7f450c0a4560 2024-04-17T02:22:33.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.053+0000 7f45097fa640 1 -- 172.21.15.17:0/203554631 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f44f4097130 con 0x7f450c0a4560 2024-04-17T02:22:33.054 INFO:teuthology.orchestra.run.smithi017.stdout:38654705671 2024-04-17T02:22:33.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.055+0000 7f4512445640 10 mgrc shutdown 2024-04-17T02:22:33.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.055+0000 7f4512445640 1 -- 172.21.15.17:0/203554631 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f44ec09f4b0 msgr2=0x7f44ec0a1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:33.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.055+0000 7f4512445640 1 --2- 172.21.15.17:0/203554631 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f44ec09f4b0 0x7f44ec0a1970 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f44fc009560 tx=0x7f44fc008030 comp rx=0 tx=0).stop 2024-04-17T02:22:33.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.055+0000 7f4512445640 1 -- 172.21.15.17:0/203554631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f450c0a4560 msgr2=0x7f450c1ddd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:33.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.055+0000 7f4512445640 1 --2- 172.21.15.17:0/203554631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f450c0a4560 0x7f450c1ddd80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f44f400c500 tx=0x7f44f400c9c0 comp rx=0 tx=0).stop 2024-04-17T02:22:33.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.056+0000 7f4512445640 1 -- 172.21.15.17:0/203554631 shutdown_connections 2024-04-17T02:22:33.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.056+0000 7f4512445640 1 --2- 172.21.15.17:0/203554631 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f44ec09f4b0 0x7f44ec0a1970 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:33.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.056+0000 7f4512445640 1 --2- 172.21.15.17:0/203554631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f450c0a4560 0x7f450c1ddd80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:33.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.056+0000 7f4512445640 1 --2- 172.21.15.17:0/203554631 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f450c0a81b0 0x7f450c1de2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:33.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.056+0000 7f4512445640 1 --2- 172.21.15.17:0/203554631 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f450c0674b0 0x7f450c071d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:33.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.056+0000 7f4512445640 1 -- 172.21.15.17:0/203554631 >> 172.21.15.17:0/203554631 conn(0x7f450c0a6680 msgr2=0x7f450c06b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:33.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.056+0000 7f4512445640 1 -- 172.21.15.17:0/203554631 shutdown_connections 2024-04-17T02:22:33.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.056+0000 7f4512445640 1 -- 172.21.15.17:0/203554631 wait complete. 2024-04-17T02:22:33.068 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705671 for osd.1 2024-04-17T02:22:33.069 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705670 for osd.2 2024-04-17T02:22:33.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.076+0000 7fd0ec686640 1 -- 172.21.15.17:0/1094706796 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fd0e40b71d0 con 0x7fd0e414cd70 2024-04-17T02:22:33.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.076+0000 7fd0daffd640 1 -- 172.21.15.17:0/1094706796 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd0dc098650 con 0x7fd0e414cd70 2024-04-17T02:22:33.077 INFO:teuthology.orchestra.run.smithi017.stdout:38654705671 2024-04-17T02:22:33.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.078+0000 7fd0ec686640 10 mgrc shutdown 2024-04-17T02:22:33.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.078+0000 7fd0ec686640 1 -- 172.21.15.17:0/1094706796 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fd0c809f430 msgr2=0x7fd0c80a18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:33.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.078+0000 7fd0ec686640 1 --2- 172.21.15.17:0/1094706796 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fd0c809f430 0x7fd0c80a18f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0009560 tx=0x7fd0e0008030 comp rx=0 tx=0).stop 2024-04-17T02:22:33.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.078+0000 7fd0ec686640 1 -- 172.21.15.17:0/1094706796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0e414cd70 msgr2=0x7fd0e413b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:33.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.078+0000 7fd0ec686640 1 --2- 172.21.15.17:0/1094706796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0e414cd70 0x7fd0e413b050 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd0e406d480 tx=0x7fd0dc00cb90 comp rx=0 tx=0).stop 2024-04-17T02:22:33.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.078+0000 7fd0ec686640 1 -- 172.21.15.17:0/1094706796 shutdown_connections 2024-04-17T02:22:33.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.078+0000 7fd0ec686640 1 --2- 172.21.15.17:0/1094706796 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fd0c809f430 0x7fd0c80a18f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:33.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.078+0000 7fd0ec686640 1 --2- 172.21.15.17:0/1094706796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0e40a8660 0x7fd0e4145190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:33.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.078+0000 7fd0ec686640 1 --2- 172.21.15.17:0/1094706796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0e414cd70 0x7fd0e413b050 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:33.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.078+0000 7fd0ec686640 1 --2- 172.21.15.17:0/1094706796 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd0e40a81f0 0x7fd0e4071c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:33.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.078+0000 7fd0ec686640 1 -- 172.21.15.17:0/1094706796 >> 172.21.15.17:0/1094706796 conn(0x7fd0e40ba940 msgr2=0x7fd0e40bad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:33.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.079+0000 7fd0ec686640 1 -- 172.21.15.17:0/1094706796 shutdown_connections 2024-04-17T02:22:33.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.079+0000 7fd0ec686640 1 -- 172.21.15.17:0/1094706796 wait complete. 2024-04-17T02:22:33.090 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705671 for osd.3 2024-04-17T02:22:33.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.091+0000 7feead38f640 1 -- 172.21.15.17:0/3061268362 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7feea80a4d50 con 0x7feea80a7b70 2024-04-17T02:22:33.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.092+0000 7fee9f7fe640 1 -- 172.21.15.17:0/3061268362 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fee98098260 con 0x7feea80a7b70 2024-04-17T02:22:33.093 INFO:teuthology.orchestra.run.smithi017.stdout:38654705671 2024-04-17T02:22:33.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.094+0000 7feead38f640 10 mgrc shutdown 2024-04-17T02:22:33.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.094+0000 7feead38f640 1 -- 172.21.15.17:0/3061268362 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fee8809f400 msgr2=0x7fee880a18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:33.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.094+0000 7feead38f640 1 --2- 172.21.15.17:0/3061268362 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fee8809f400 0x7fee880a18c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fee90036000 tx=0x7fee9003d040 comp rx=0 tx=0).stop 2024-04-17T02:22:33.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.094+0000 7feead38f640 1 -- 172.21.15.17:0/3061268362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feea80a7b70 msgr2=0x7feea809a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:33.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.094+0000 7feead38f640 1 --2- 172.21.15.17:0/3061268362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feea80a7b70 0x7feea809a4a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fee9800e9e0 tx=0x7fee9800eea0 comp rx=0 tx=0).stop 2024-04-17T02:22:33.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.094+0000 7feead38f640 1 -- 172.21.15.17:0/3061268362 shutdown_connections 2024-04-17T02:22:33.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.094+0000 7feead38f640 1 --2- 172.21.15.17:0/3061268362 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fee8809f400 0x7fee880a18c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:33.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.094+0000 7feead38f640 1 --2- 172.21.15.17:0/3061268362 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feea8144e90 0x7feea809bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:33.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.094+0000 7feead38f640 1 --2- 172.21.15.17:0/3061268362 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7feea8140de0 0x7feea809b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:33.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.094+0000 7feead38f640 1 --2- 172.21.15.17:0/3061268362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feea80a7b70 0x7feea809a4a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:33.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.094+0000 7feead38f640 1 -- 172.21.15.17:0/3061268362 >> 172.21.15.17:0/3061268362 conn(0x7feea80a6150 msgr2=0x7feea80a1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:33.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.094+0000 7feead38f640 1 -- 172.21.15.17:0/3061268362 shutdown_connections 2024-04-17T02:22:33.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:33.094+0000 7feead38f640 1 -- 172.21.15.17:0/3061268362 wait complete. 2024-04-17T02:22:33.106 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705671 for osd.0 2024-04-17T02:22:34.069 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-17T02:22:34.070 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-17T02:22:34.091 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-17T02:22:34.107 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-17T02:22:34.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.189+0000 7f157232a640 1 Processor -- start 2024-04-17T02:22:34.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.189+0000 7f1128b7a640 1 Processor -- start 2024-04-17T02:22:34.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.189+0000 7f157232a640 1 -- start start 2024-04-17T02:22:34.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.190+0000 7f1128b7a640 1 -- start start 2024-04-17T02:22:34.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.190+0000 7f157232a640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f156c06f600 0x7f156c0aa120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:34.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.190+0000 7f1128b7a640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f11240a7f70 0x7f11240a5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:34.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.190+0000 7f157232a640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f156c0aa940 0x7f156c148550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:34.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.190+0000 7f157232a640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f156c0a59a0 con 0x7f156c0a84d0 2024-04-17T02:22:34.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.190+0000 7f157232a640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f156c0a88b0 con 0x7f156c0aa940 2024-04-17T02:22:34.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.190+0000 7f157232a640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f156c148c10 con 0x7f156c06f600 2024-04-17T02:22:34.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.190+0000 7f1128b7a640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1124148d90 0x7f112414f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:34.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.190+0000 7f1128b7a640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11240723a0 con 0x7f112413b990 2024-04-17T02:22:34.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.190+0000 7f1128b7a640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f11240a8350 con 0x7f11240a7f70 2024-04-17T02:22:34.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.190+0000 7f1128b7a640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f11240a77f0 con 0x7f1124148d90 2024-04-17T02:22:34.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.190+0000 7f112259c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f11240a7f70 0x7f11240a5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:34.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.190+0000 7f112259c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f11240a7f70 0x7f11240a5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52502/0 (socket says 172.21.15.17:52502) 2024-04-17T02:22:34.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.190+0000 7f112259c640 1 -- 172.21.15.17:0/2089695921 learned_addr learned my addr 172.21.15.17:0/2089695921 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:34.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.190+0000 7f156b7fe640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f156c06f600 0x7f156c0aa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:34.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.190+0000 7f156bfff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f156c0a84d0 0x7f156c144710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42048/0 (socket says 172.21.15.17:42048) 2024-04-17T02:22:34.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.190+0000 7f156b7fe640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f156c06f600 0x7f156c0aa120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:53106/0 (socket says 172.21.15.17:53106) 2024-04-17T02:22:34.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.190+0000 7f156bfff640 1 -- 172.21.15.17:0/2028246337 learned_addr learned my addr 172.21.15.17:0/2028246337 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:22:34.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.191+0000 7f1122d9d640 1 --2- 172.21.15.17:0/2089695921 >> v2:172.21.15.122:3300/0 conn(0x7f1124148d90 0x7f112414f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:34.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.191+0000 7f112259c640 1 -- 172.21.15.17:0/2089695921 >> v2:172.21.15.122:3300/0 conn(0x7f1124148d90 msgr2=0x7f112414f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:34.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.191+0000 7f112259c640 1 --2- 172.21.15.17:0/2089695921 >> v2:172.21.15.122:3300/0 conn(0x7f1124148d90 0x7f112414f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.191+0000 7f112259c640 1 -- 172.21.15.17:0/2089695921 >> v1:172.21.15.122:6789/0 conn(0x7f112413b990 legacy=0x7f11240a6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:34.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.191+0000 7f112259c640 1 -- 172.21.15.17:0/2089695921 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11241485f0 con 0x7f11240a7f70 2024-04-17T02:22:34.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.191+0000 7f15708c7640 1 --2- 172.21.15.17:0/2028246337 >> v2:172.21.15.122:3300/0 conn(0x7f156c0aa940 0x7f156c148550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:34.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.191+0000 7f156b7fe640 1 -- 172.21.15.17:0/2028246337 >> v2:172.21.15.122:3300/0 conn(0x7f156c0aa940 msgr2=0x7f156c148550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:34.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.191+0000 7f156b7fe640 1 --2- 172.21.15.17:0/2028246337 >> v2:172.21.15.122:3300/0 conn(0x7f156c0aa940 0x7f156c148550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.191+0000 7f156b7fe640 1 -- 172.21.15.17:0/2028246337 >> v1:172.21.15.17:6789/0 conn(0x7f156c0a84d0 legacy=0x7f156c144710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:34.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.191+0000 7f156b7fe640 1 -- 172.21.15.17:0/2028246337 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f156c148ed0 con 0x7f156c06f600 2024-04-17T02:22:34.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.192+0000 7f112259c640 1 --2- 172.21.15.17:0/2089695921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11240a7f70 0x7f11240a5aa0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f112413b920 tx=0x7f111402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63e57b2ece6015a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:34.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.192+0000 7f156b7fe640 1 --2- 172.21.15.17:0/2028246337 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f156c06f600 0x7f156c0aa120 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f15600097a0 tx=0x7f156002b710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95b3ae5438280707 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:34.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.192+0000 7f1121d9b640 1 -- 172.21.15.17:0/2089695921 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1114035020 con 0x7f11240a7f70 2024-04-17T02:22:34.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.192+0000 7f1121d9b640 1 -- 172.21.15.17:0/2089695921 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1114031870 con 0x7f11240a7f70 2024-04-17T02:22:34.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.192+0000 7f1121d9b640 1 -- 172.21.15.17:0/2089695921 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1114031c40 con 0x7f11240a7f70 2024-04-17T02:22:34.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.192+0000 7f156affd640 1 -- 172.21.15.17:0/2028246337 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1560037070 con 0x7f156c06f600 2024-04-17T02:22:34.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.192+0000 7f156affd640 1 -- 172.21.15.17:0/2028246337 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1560030710 con 0x7f156c06f600 2024-04-17T02:22:34.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.192+0000 7f156affd640 1 -- 172.21.15.17:0/2028246337 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1560030ae0 con 0x7f156c06f600 2024-04-17T02:22:34.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.193+0000 7f1128b7a640 1 -- 172.21.15.17:0/2089695921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11240a7f70 msgr2=0x7f11240a5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:34.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.193+0000 7f1128b7a640 1 --2- 172.21.15.17:0/2089695921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11240a7f70 0x7f11240a5aa0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f112413b920 tx=0x7f111402b910 comp rx=0 tx=0).stop 2024-04-17T02:22:34.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.193+0000 7f157232a640 1 -- 172.21.15.17:0/2028246337 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f156c06f600 msgr2=0x7f156c0aa120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:34.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.193+0000 7f157232a640 1 --2- 172.21.15.17:0/2028246337 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f156c06f600 0x7f156c0aa120 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f15600097a0 tx=0x7f156002b710 comp rx=0 tx=0).stop 2024-04-17T02:22:34.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.193+0000 7f1128b7a640 1 -- 172.21.15.17:0/2089695921 shutdown_connections 2024-04-17T02:22:34.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.193+0000 7f157232a640 1 -- 172.21.15.17:0/2028246337 shutdown_connections 2024-04-17T02:22:34.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.193+0000 7f157232a640 1 --2- 172.21.15.17:0/2028246337 >> v2:172.21.15.122:3300/0 conn(0x7f156c0aa940 0x7f156c148550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.193+0000 7f1128b7a640 1 --2- 172.21.15.17:0/2089695921 >> v2:172.21.15.122:3300/0 conn(0x7f1124148d90 0x7f112414f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.193+0000 7f1128b7a640 1 --2- 172.21.15.17:0/2089695921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11240a7f70 0x7f11240a5aa0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.193+0000 7f1128b7a640 1 -- 172.21.15.17:0/2089695921 >> 172.21.15.17:0/2089695921 conn(0x7f11240741a0 msgr2=0x7f11240745b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:34.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.193+0000 7f157232a640 1 --2- 172.21.15.17:0/2028246337 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f156c06f600 0x7f156c0aa120 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.193+0000 7f157232a640 1 -- 172.21.15.17:0/2028246337 >> 172.21.15.17:0/2028246337 conn(0x7f156c0746a0 msgr2=0x7f156c0a7ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:34.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.193+0000 7f1128b7a640 1 -- 172.21.15.17:0/2089695921 shutdown_connections 2024-04-17T02:22:34.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.193+0000 7f157232a640 1 -- 172.21.15.17:0/2028246337 shutdown_connections 2024-04-17T02:22:34.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.193+0000 7f157232a640 1 -- 172.21.15.17:0/2028246337 wait complete. 2024-04-17T02:22:34.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.193+0000 7f1128b7a640 1 -- 172.21.15.17:0/2089695921 wait complete. 2024-04-17T02:22:34.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.194+0000 7f157232a640 1 Processor -- start 2024-04-17T02:22:34.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.194+0000 7f157232a640 1 -- start start 2024-04-17T02:22:34.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.195+0000 7f1128b7a640 1 Processor -- start 2024-04-17T02:22:34.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.195+0000 7f1128b7a640 1 -- start start 2024-04-17T02:22:34.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.195+0000 7f157232a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f156c0a84d0 0x7f156c0b9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:34.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.195+0000 7f157232a640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f156c0aa940 0x7f156c06e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:34.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.195+0000 7f157232a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f156c0b77d0 0x7f156c0b7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:34.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.195+0000 7f157232a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f156c14f880 con 0x7f156c0b77d0 2024-04-17T02:22:34.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.195+0000 7f157232a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f156c144e50 con 0x7f156c0a84d0 2024-04-17T02:22:34.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.195+0000 7f157232a640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f156c14fa00 con 0x7f156c0aa940 2024-04-17T02:22:34.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.195+0000 7f156b7fe640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f156c0aa940 0x7f156c06e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:34.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.195+0000 7f15708c7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f156c0b77d0 0x7f156c0b7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:34.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.195+0000 7f156b7fe640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f156c0aa940 0x7f156c06e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:53120/0 (socket says 172.21.15.17:53120) 2024-04-17T02:22:34.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.195+0000 7f156b7fe640 1 -- 172.21.15.17:0/915148036 learned_addr learned my addr 172.21.15.17:0/915148036 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:34.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.195+0000 7f156bfff640 1 --2- 172.21.15.17:0/915148036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f156c0a84d0 0x7f156c0b9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:34.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.195+0000 7f15708c7640 1 -- 172.21.15.17:0/915148036 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f156c0aa940 msgr2=0x7f156c06e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:34.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.195+0000 7f15708c7640 1 --2- 172.21.15.17:0/915148036 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f156c0aa940 0x7f156c06e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.195+0000 7f15708c7640 1 -- 172.21.15.17:0/915148036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f156c0a84d0 msgr2=0x7f156c0b9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:34.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.195+0000 7f15708c7640 1 --2- 172.21.15.17:0/915148036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f156c0a84d0 0x7f156c0b9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.195+0000 7f15708c7640 1 -- 172.21.15.17:0/915148036 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f156c13ae80 con 0x7f156c0b77d0 2024-04-17T02:22:34.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.196+0000 7f156b7fe640 1 --2- 172.21.15.17:0/915148036 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f156c0aa940 0x7f156c06e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:34.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.196+0000 7f156bfff640 1 --2- 172.21.15.17:0/915148036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f156c0a84d0 0x7f156c0b9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:34.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.196+0000 7f1128b7a640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f11240a7f70 0x7f11241d1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:34.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.196+0000 7f1128b7a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f112413b990 0x7f11240b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:34.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.196+0000 7f1128b7a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1124148d90 0x7f11240b7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:34.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.196+0000 7f1128b7a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1124149240 con 0x7f112413b990 2024-04-17T02:22:34.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.196+0000 7f1128b7a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f11240a7530 con 0x7f1124148d90 2024-04-17T02:22:34.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.196+0000 7f1128b7a640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f11241493c0 con 0x7f11240a7f70 2024-04-17T02:22:34.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.196+0000 7f112259c640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f11240a7f70 0x7f11241d1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:34.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.196+0000 7f112259c640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f11240a7f70 0x7f11241d1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:53128/0 (socket says 172.21.15.17:53128) 2024-04-17T02:22:34.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.196+0000 7f112259c640 1 -- 172.21.15.17:0/3014867962 learned_addr learned my addr 172.21.15.17:0/3014867962 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:34.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.196+0000 7f15708c7640 1 --2- 172.21.15.17:0/915148036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f156c0b77d0 0x7f156c0b7c80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1564007d20 tx=0x7f156400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:34.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.196+0000 7f111bfff640 1 --2- 172.21.15.17:0/3014867962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f112413b990 0x7f11240b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:34.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.196+0000 7f1122d9d640 1 --2- 172.21.15.17:0/3014867962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1124148d90 0x7f11240b7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:34.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.196+0000 7f1568ff9640 1 -- 172.21.15.17:0/915148036 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f156400edd0 con 0x7f156c0b77d0 2024-04-17T02:22:34.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.196+0000 7f1568ff9640 1 -- 172.21.15.17:0/915148036 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1564003990 con 0x7f156c0b77d0 2024-04-17T02:22:34.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.196+0000 7f1568ff9640 1 -- 172.21.15.17:0/915148036 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1564003d80 con 0x7f156c0b77d0 2024-04-17T02:22:34.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.196+0000 7f112259c640 1 -- 172.21.15.17:0/3014867962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1124148d90 msgr2=0x7f11240b7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:34.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.196+0000 7f112259c640 1 --2- 172.21.15.17:0/3014867962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1124148d90 0x7f11240b7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.196+0000 7f112259c640 1 -- 172.21.15.17:0/3014867962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f112413b990 msgr2=0x7f11240b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:34.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.196+0000 7f112259c640 1 --2- 172.21.15.17:0/3014867962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f112413b990 0x7f11240b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.196+0000 7f112259c640 1 -- 172.21.15.17:0/3014867962 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11240b6050 con 0x7f11240a7f70 2024-04-17T02:22:34.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.196+0000 7f157232a640 1 -- 172.21.15.17:0/915148036 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f156c13b140 con 0x7f156c0b77d0 2024-04-17T02:22:34.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.196+0000 7f112259c640 1 --2- 172.21.15.17:0/3014867962 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f11240a7f70 0x7f11241d1cf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1114000c00 tx=0x7f11140046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:34.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.196+0000 7f157232a640 1 -- 172.21.15.17:0/915148036 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f156c06ed70 con 0x7f156c0b77d0 2024-04-17T02:22:34.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.197+0000 7f111affd640 1 -- 172.21.15.17:0/3014867962 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111403ad60 con 0x7f11240a7f70 2024-04-17T02:22:34.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.197+0000 7f111affd640 1 -- 172.21.15.17:0/3014867962 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11140443f0 con 0x7f11240a7f70 2024-04-17T02:22:34.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.197+0000 7f1128b7a640 1 -- 172.21.15.17:0/3014867962 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11240b5de0 con 0x7f11240a7f70 2024-04-17T02:22:34.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.197+0000 7f111affd640 1 -- 172.21.15.17:0/3014867962 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11140447c0 con 0x7f11240a7f70 2024-04-17T02:22:34.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.197+0000 7f1128b7a640 1 -- 172.21.15.17:0/3014867962 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f11240a22e0 con 0x7f11240a7f70 2024-04-17T02:22:34.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.198+0000 7f157232a640 1 -- 172.21.15.17:0/915148036 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f156c067f80 con 0x7f156c0b77d0 2024-04-17T02:22:34.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.198+0000 7f1128b7a640 1 -- 172.21.15.17:0/3014867962 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11240687f0 con 0x7f11240a7f70 2024-04-17T02:22:34.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.199+0000 7f1568ff9640 1 -- 172.21.15.17:0/915148036 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f156401b020 con 0x7f156c0b77d0 2024-04-17T02:22:34.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.199+0000 7f1568ff9640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:34.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.200+0000 7f1568ff9640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:34.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.200+0000 7f1568ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:34.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.200+0000 7f1568ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:34.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.200+0000 7f1568ff9640 1 --2- 172.21.15.17:0/915148036 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f155809f400 0x7f15580a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:34.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.200+0000 7f1568ff9640 1 -- 172.21.15.17:0/915148036 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f15640c9710 con 0x7f156c0b77d0 2024-04-17T02:22:34.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.200+0000 7f156bfff640 1 --2- 172.21.15.17:0/915148036 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f155809f400 0x7f15580a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:34.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.200+0000 7f111affd640 1 -- 172.21.15.17:0/3014867962 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f111404b060 con 0x7f11240a7f70 2024-04-17T02:22:34.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.200+0000 7f111affd640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:34.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.201+0000 7f156bfff640 1 --2- 172.21.15.17:0/915148036 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f155809f400 0x7f15580a18c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f155c007c90 tx=0x7f155c007be0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:34.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.201+0000 7f111affd640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:34.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.201+0000 7f111affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:34.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.201+0000 7f111affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:34.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.201+0000 7f111affd640 1 --2- 172.21.15.17:0/3014867962 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f110409f550 0x7f11040a1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:34.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.202+0000 7f111bfff640 1 --2- 172.21.15.17:0/3014867962 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f110409f550 0x7f11040a1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:34.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.202+0000 7f111affd640 1 -- 172.21.15.17:0/3014867962 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f11140eb810 con 0x7f11240a7f70 2024-04-17T02:22:34.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.202+0000 7f111bfff640 1 --2- 172.21.15.17:0/3014867962 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f110409f550 0x7f11040a1a10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f112406f090 tx=0x7f110c009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:34.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.205+0000 7f1568ff9640 1 -- 172.21.15.17:0/915148036 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f1564098770 con 0x7f156c0b77d0 2024-04-17T02:22:34.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.208+0000 7f111affd640 1 -- 172.21.15.17:0/3014867962 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f111403f070 con 0x7f11240a7f70 2024-04-17T02:22:34.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.230+0000 7f09185e6640 1 Processor -- start 2024-04-17T02:22:34.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.230+0000 7f09185e6640 1 -- start start 2024-04-17T02:22:34.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.231+0000 7f09185e6640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f09100bb460 0x7f0910142580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:34.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.231+0000 7f09185e6640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f0910142ac0 0x7f091014fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:34.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.231+0000 7f09185e6640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09100acea0 con 0x7f09100ab5b0 2024-04-17T02:22:34.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.231+0000 7f09185e6640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f09100ab990 con 0x7f0910142ac0 2024-04-17T02:22:34.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.231+0000 7f09185e6640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f091006c330 con 0x7f09100bb460 2024-04-17T02:22:34.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.231+0000 7f0916382640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f09100ab5b0 0x7f09100ac680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42052/0 (socket says 172.21.15.17:42052) 2024-04-17T02:22:34.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.231+0000 7f0915b81640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f09100bb460 0x7f0910142580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:34.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.231+0000 7f0916382640 1 -- 172.21.15.17:0/653436279 learned_addr learned my addr 172.21.15.17:0/653436279 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:22:34.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.232+0000 7f0916b83640 1 --2- 172.21.15.17:0/653436279 >> v2:172.21.15.122:3300/0 conn(0x7f0910142ac0 0x7f091014fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:34.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.232+0000 7f0915380640 1 -- 172.21.15.17:0/653436279 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2926466113 0 0) 0x7f09100acea0 con 0x7f09100ab5b0 2024-04-17T02:22:34.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.232+0000 7f0915380640 1 -- 172.21.15.17:0/653436279 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08fc003520 con 0x7f09100ab5b0 2024-04-17T02:22:34.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.232+0000 7f0916b83640 1 -- 172.21.15.17:0/653436279 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f09100bb460 msgr2=0x7f0910142580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:34.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.232+0000 7f0916b83640 1 --2- 172.21.15.17:0/653436279 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f09100bb460 0x7f0910142580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.232+0000 7f0916b83640 1 -- 172.21.15.17:0/653436279 >> v1:172.21.15.17:6789/0 conn(0x7f09100ab5b0 legacy=0x7f09100ac680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:34.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.232+0000 7f0916b83640 1 -- 172.21.15.17:0/653436279 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f091006dd30 con 0x7f0910142ac0 2024-04-17T02:22:34.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.232+0000 7f0915b81640 1 --2- 172.21.15.17:0/653436279 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f09100bb460 0x7f0910142580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:34.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.232+0000 7f98ac5bf640 1 Processor -- start 2024-04-17T02:22:34.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.232+0000 7f98ac5bf640 1 -- start start 2024-04-17T02:22:34.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.233+0000 7f0916b83640 1 --2- 172.21.15.17:0/653436279 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0910142ac0 0x7f091014fa90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0908009d90 tx=0x7f090802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c30ed9787b96dee7 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:34.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.233+0000 7f0915380640 1 -- 172.21.15.17:0/653436279 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0908039070 con 0x7f0910142ac0 2024-04-17T02:22:34.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.233+0000 7f0915380640 1 -- 172.21.15.17:0/653436279 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f090802cc50 con 0x7f0910142ac0 2024-04-17T02:22:34.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.233+0000 7f0915380640 1 -- 172.21.15.17:0/653436279 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0908034440 con 0x7f0910142ac0 2024-04-17T02:22:34.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.233+0000 7f98ac5bf640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f98a40a8530 0x7f98a40aa0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:34.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.233+0000 7f98ac5bf640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f98a40a7200 0x7f98a4144680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:34.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.233+0000 7f98ac5bf640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f98a4144bc0 0x7f98a4145050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:34.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.233+0000 7f98ac5bf640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f98a40a8910 con 0x7f98a40a7200 2024-04-17T02:22:34.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.233+0000 7f98ac5bf640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f98a4145680 con 0x7f98a4144bc0 2024-04-17T02:22:34.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.233+0000 7f98ac5bf640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f98a4145940 con 0x7f98a40a8530 2024-04-17T02:22:34.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.233+0000 7f98aa35b640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f98a40a8530 0x7f98a40aa0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:34.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.233+0000 7f98a9b5a640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f98a40a7200 0x7f98a4144680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:34.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.233+0000 7f98a9b5a640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f98a40a7200 0x7f98a4144680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52522/0 (socket says 172.21.15.17:52522) 2024-04-17T02:22:34.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.234+0000 7f98a9b5a640 1 -- 172.21.15.17:0/4007842228 learned_addr learned my addr 172.21.15.17:0/4007842228 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:34.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.233+0000 7f98aa35b640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f98a40a8530 0x7f98a40aa0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:53142/0 (socket says 172.21.15.17:53142) 2024-04-17T02:22:34.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.234+0000 7f98aab5c640 1 --2- 172.21.15.17:0/4007842228 >> v2:172.21.15.122:3300/0 conn(0x7f98a4144bc0 0x7f98a4145050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:34.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.234+0000 7f98a9b5a640 1 -- 172.21.15.17:0/4007842228 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f98a40a8530 msgr2=0x7f98a40aa0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:34.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.234+0000 7f98a9b5a640 1 --2- 172.21.15.17:0/4007842228 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f98a40a8530 0x7f98a40aa0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.234+0000 7f98a9b5a640 1 -- 172.21.15.17:0/4007842228 >> v2:172.21.15.122:3300/0 conn(0x7f98a4144bc0 msgr2=0x7f98a4145050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:34.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.234+0000 7f98a9b5a640 1 --2- 172.21.15.17:0/4007842228 >> v2:172.21.15.122:3300/0 conn(0x7f98a4144bc0 0x7f98a4145050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.234+0000 7f98a9b5a640 1 -- 172.21.15.17:0/4007842228 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98a40aaac0 con 0x7f98a40a7200 2024-04-17T02:22:34.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.234+0000 7f09185e6640 1 -- 172.21.15.17:0/653436279 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0910142ac0 msgr2=0x7f091014fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:34.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.234+0000 7f09185e6640 1 --2- 172.21.15.17:0/653436279 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0910142ac0 0x7f091014fa90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0908009d90 tx=0x7f090802bea0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.234+0000 7f09185e6640 1 -- 172.21.15.17:0/653436279 shutdown_connections 2024-04-17T02:22:34.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.234+0000 7f09185e6640 1 --2- 172.21.15.17:0/653436279 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0910142ac0 0x7f091014fa90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.234+0000 7f09185e6640 1 --2- 172.21.15.17:0/653436279 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f09100bb460 0x7f0910142580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.234+0000 7f09185e6640 1 -- 172.21.15.17:0/653436279 >> 172.21.15.17:0/653436279 conn(0x7f09100ba940 msgr2=0x7f09100bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.234+0000 7f09185e6640 1 -- 172.21.15.17:0/653436279 shutdown_connections 2024-04-17T02:22:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.234+0000 7f09185e6640 1 -- 172.21.15.17:0/653436279 wait complete. 2024-04-17T02:22:34.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.235+0000 7f98a9b5a640 1 --2- 172.21.15.17:0/4007842228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98a40a7200 0x7f98a4144680 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f98a4145590 tx=0x7f989402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b690e85ef0a8d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:34.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.235+0000 7f98a9359640 1 -- 172.21.15.17:0/4007842228 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f989402e070 con 0x7f98a40a7200 2024-04-17T02:22:34.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.235+0000 7f98a9359640 1 -- 172.21.15.17:0/4007842228 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9894037070 con 0x7f98a40a7200 2024-04-17T02:22:34.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.235+0000 7f98a9359640 1 -- 172.21.15.17:0/4007842228 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9894031a00 con 0x7f98a40a7200 2024-04-17T02:22:34.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.236+0000 7f98ac5bf640 1 -- 172.21.15.17:0/4007842228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98a40a7200 msgr2=0x7f98a4144680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:34.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.236+0000 7f98ac5bf640 1 --2- 172.21.15.17:0/4007842228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98a40a7200 0x7f98a4144680 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f98a4145590 tx=0x7f989402b880 comp rx=0 tx=0).stop 2024-04-17T02:22:34.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.236+0000 7f98ac5bf640 1 -- 172.21.15.17:0/4007842228 shutdown_connections 2024-04-17T02:22:34.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.236+0000 7f98ac5bf640 1 --2- 172.21.15.17:0/4007842228 >> v2:172.21.15.122:3300/0 conn(0x7f98a4144bc0 0x7f98a4145050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.236+0000 7f98ac5bf640 1 --2- 172.21.15.17:0/4007842228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98a40a7200 0x7f98a4144680 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.236+0000 7f98ac5bf640 1 --2- 172.21.15.17:0/4007842228 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f98a40a8530 0x7f98a40aa0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.236+0000 7f98ac5bf640 1 -- 172.21.15.17:0/4007842228 >> 172.21.15.17:0/4007842228 conn(0x7f98a40746d0 msgr2=0x7f98a40a7ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:34.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.236+0000 7f98ac5bf640 1 -- 172.21.15.17:0/4007842228 shutdown_connections 2024-04-17T02:22:34.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.236+0000 7f98ac5bf640 1 -- 172.21.15.17:0/4007842228 wait complete. 2024-04-17T02:22:34.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.236+0000 7f09185e6640 1 Processor -- start 2024-04-17T02:22:34.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.237+0000 7f09185e6640 1 -- start start 2024-04-17T02:22:34.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.237+0000 7f98ac5bf640 1 Processor -- start 2024-04-17T02:22:34.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.237+0000 7f98ac5bf640 1 -- start start 2024-04-17T02:22:34.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.237+0000 7f98ac5bf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98a40a7200 0x7f98a409ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:34.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.237+0000 7f98ac5bf640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98a40a8530 0x7f98a4148b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:34.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.237+0000 7f98ac5bf640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f98a4144bc0 0x7f98a41db020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:34.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.238+0000 7f98ac5bf640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f98a40a77e0 con 0x7f98a40a7200 2024-04-17T02:22:34.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.238+0000 7f98ac5bf640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f98a40a7660 con 0x7f98a40a8530 2024-04-17T02:22:34.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.238+0000 7f98aab5c640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f98a4144bc0 0x7f98a41db020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:34.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.238+0000 7f98aa35b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98a40a7200 0x7f98a409ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:34.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.238+0000 7f98aab5c640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f98a4144bc0 0x7f98a41db020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:53154/0 (socket says 172.21.15.17:53154) 2024-04-17T02:22:34.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.238+0000 7f98aab5c640 1 -- 172.21.15.17:0/3710817071 learned_addr learned my addr 172.21.15.17:0/3710817071 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:34.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.238+0000 7f98aa35b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98a40a7200 0x7f98a409ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52534/0 (socket says 172.21.15.17:52534) 2024-04-17T02:22:34.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.238+0000 7f98ac5bf640 1 -- 172.21.15.17:0/3710817071 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f98a4071ad0 con 0x7f98a4144bc0 2024-04-17T02:22:34.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.238+0000 7f09185e6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09100ab5b0 0x7f091013e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:34.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.238+0000 7f98a9b5a640 1 --2- 172.21.15.17:0/3710817071 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98a40a8530 0x7f98a4148b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:34.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.238+0000 7f09185e6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09100bb460 0x7f0910147c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:34.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.238+0000 7f98aab5c640 1 -- 172.21.15.17:0/3710817071 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98a40a8530 msgr2=0x7f98a4148b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:34.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.238+0000 7f98aab5c640 1 --2- 172.21.15.17:0/3710817071 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98a40a8530 0x7f98a4148b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.238+0000 7f98aab5c640 1 -- 172.21.15.17:0/3710817071 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98a40a7200 msgr2=0x7f98a409ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:34.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.238+0000 7f09185e6640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f0910142ac0 0x7f0910145bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:34.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.238+0000 7f0916382640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09100ab5b0 0x7f091013e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:34.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.238+0000 7f0916382640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09100ab5b0 0x7f091013e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.17:42476/0 (socket says 172.21.15.17:42476) 2024-04-17T02:22:34.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.238+0000 7f98aab5c640 1 --2- 172.21.15.17:0/3710817071 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98a40a7200 0x7f98a409ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.238+0000 7f98aab5c640 1 -- 172.21.15.17:0/3710817071 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98a41dad60 con 0x7f98a4144bc0 2024-04-17T02:22:34.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.238+0000 7f98a9b5a640 1 --2- 172.21.15.17:0/3710817071 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98a40a8530 0x7f98a4148b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T02:22:34.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.238+0000 7f0915b81640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09100bb460 0x7f0910147c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:34.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.238+0000 7f0915b81640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09100bb460 0x7f0910147c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52542/0 (socket says 172.21.15.17:52542) 2024-04-17T02:22:34.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.238+0000 7f98aa35b640 1 --2- 172.21.15.17:0/3710817071 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98a40a7200 0x7f98a409ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:34.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.238+0000 7f0916b83640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f0910142ac0 0x7f0910145bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:34.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.238+0000 7f0916b83640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f0910142ac0 0x7f0910145bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:53156/0 (socket says 172.21.15.17:53156) 2024-04-17T02:22:34.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.238+0000 7f0916382640 1 -- 172.21.15.17:0/3423275108 learned_addr learned my addr 172.21.15.17:0/3423275108 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:34.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.238+0000 7f98aab5c640 1 --2- 172.21.15.17:0/3710817071 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f98a4144bc0 0x7f98a41db020 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f989c00efc0 tx=0x7f989c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:34.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.238+0000 7f09185e6640 1 -- 172.21.15.17:0/3423275108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f09100a9880 con 0x7f09100bb460 2024-04-17T02:22:34.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.239+0000 7f09185e6640 1 -- 172.21.15.17:0/3423275108 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f09100a9700 con 0x7f09100ab5b0 2024-04-17T02:22:34.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.239+0000 7f09185e6640 1 -- 172.21.15.17:0/3423275108 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f091014ffd0 con 0x7f0910142ac0 2024-04-17T02:22:34.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.239+0000 7f989affd640 1 -- 172.21.15.17:0/3710817071 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f989c018020 con 0x7f98a4144bc0 2024-04-17T02:22:34.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.239+0000 7f989affd640 1 -- 172.21.15.17:0/3710817071 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f989c014480 con 0x7f98a4144bc0 2024-04-17T02:22:34.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.239+0000 7f98ac5bf640 1 -- 172.21.15.17:0/3710817071 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98a409e1d0 con 0x7f98a4144bc0 2024-04-17T02:22:34.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.239+0000 7f0915b81640 1 -- 172.21.15.17:0/3423275108 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f0910142ac0 msgr2=0x7f0910145bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:34.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.239+0000 7f0915b81640 1 --2- 172.21.15.17:0/3423275108 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f0910142ac0 0x7f0910145bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.239+0000 7f989affd640 1 -- 172.21.15.17:0/3710817071 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f989c014870 con 0x7f98a4144bc0 2024-04-17T02:22:34.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.239+0000 7f0915b81640 1 -- 172.21.15.17:0/3423275108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09100ab5b0 msgr2=0x7f091013e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:34.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.239+0000 7f0915b81640 1 --2- 172.21.15.17:0/3423275108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09100ab5b0 0x7f091013e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.239+0000 7f0915b81640 1 -- 172.21.15.17:0/3423275108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0910147520 con 0x7f09100bb460 2024-04-17T02:22:34.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.239+0000 7f0915b81640 1 --2- 172.21.15.17:0/3423275108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09100bb460 0x7f0910147c90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f090000e8d0 tx=0x7f090000ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:34.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.239+0000 7f0906ffd640 1 -- 172.21.15.17:0/3423275108 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0900017070 con 0x7f09100bb460 2024-04-17T02:22:34.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.239+0000 7f0906ffd640 1 -- 172.21.15.17:0/3423275108 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f090000c940 con 0x7f09100bb460 2024-04-17T02:22:34.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.240+0000 7f09185e6640 1 -- 172.21.15.17:0/3423275108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0910148320 con 0x7f09100bb460 2024-04-17T02:22:34.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.240+0000 7f0906ffd640 1 -- 172.21.15.17:0/3423275108 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f090000cd10 con 0x7f09100bb460 2024-04-17T02:22:34.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.240+0000 7f98ac5bf640 1 -- 172.21.15.17:0/3710817071 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f98a41cf6a0 con 0x7f98a4144bc0 2024-04-17T02:22:34.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.240+0000 7f09185e6640 1 -- 172.21.15.17:0/3423275108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0910147790 con 0x7f09100bb460 2024-04-17T02:22:34.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.242+0000 7f09185e6640 1 -- 172.21.15.17:0/3423275108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09100687f0 con 0x7f09100bb460 2024-04-17T02:22:34.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.242+0000 7f98ac5bf640 1 -- 172.21.15.17:0/3710817071 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98a40b6530 con 0x7f98a4144bc0 2024-04-17T02:22:34.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.243+0000 7f989affd640 1 -- 172.21.15.17:0/3710817071 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f989c005d10 con 0x7f98a4144bc0 2024-04-17T02:22:34.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.243+0000 7f989affd640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:34.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.243+0000 7f989affd640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:34.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.243+0000 7f989affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:34.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.243+0000 7f989affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:34.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.243+0000 7f989affd640 1 --2- 172.21.15.17:0/3710817071 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f988809f480 0x7f98880a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:34.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.243+0000 7f989affd640 1 -- 172.21.15.17:0/3710817071 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f989c0c9df0 con 0x7f98a4144bc0 2024-04-17T02:22:34.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.243+0000 7f98aa35b640 1 --2- 172.21.15.17:0/3710817071 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f988809f480 0x7f98880a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:34.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.244+0000 7f98aa35b640 1 --2- 172.21.15.17:0/3710817071 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f988809f480 0x7f98880a1940 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f98a0009f80 tx=0x7f98a0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:34.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.243+0000 7f0906ffd640 1 -- 172.21.15.17:0/3423275108 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f090001a070 con 0x7f09100bb460 2024-04-17T02:22:34.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.243+0000 7f0906ffd640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:34.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.244+0000 7f0906ffd640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:34.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.244+0000 7f0906ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:34.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.244+0000 7f0906ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:34.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.244+0000 7f0906ffd640 1 --2- 172.21.15.17:0/3423275108 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f08f409f480 0x7f08f40a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:34.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.244+0000 7f0916382640 1 --2- 172.21.15.17:0/3423275108 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f08f409f480 0x7f08f40a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:34.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.245+0000 7f0906ffd640 1 -- 172.21.15.17:0/3423275108 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f09000c9730 con 0x7f09100bb460 2024-04-17T02:22:34.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.245+0000 7f0916382640 1 --2- 172.21.15.17:0/3423275108 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f08f409f480 0x7f08f40a1940 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f090c000c00 tx=0x7f090c007d70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:34.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.248+0000 7f0906ffd640 1 -- 172.21.15.17:0/3423275108 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f09000980a0 con 0x7f09100bb460 2024-04-17T02:22:34.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.249+0000 7f989affd640 1 -- 172.21.15.17:0/3710817071 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f98a40b6530 con 0x7f98a4144bc0 2024-04-17T02:22:34.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.396+0000 7f157232a640 1 -- 172.21.15.17:0/915148036 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f156c14f660 con 0x7f156c0b77d0 2024-04-17T02:22:34.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.397+0000 7f1568ff9640 1 -- 172.21.15.17:0/915148036 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1564098070 con 0x7f156c0b77d0 2024-04-17T02:22:34.398 INFO:teuthology.orchestra.run.smithi017.stdout:38654705671 2024-04-17T02:22:34.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.399+0000 7f157232a640 10 mgrc shutdown 2024-04-17T02:22:34.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.399+0000 7f157232a640 1 -- 172.21.15.17:0/915148036 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f155809f400 msgr2=0x7f15580a18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:34.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.399+0000 7f157232a640 1 --2- 172.21.15.17:0/915148036 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f155809f400 0x7f15580a18c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f155c007c90 tx=0x7f155c007be0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.399+0000 7f157232a640 1 -- 172.21.15.17:0/915148036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f156c0b77d0 msgr2=0x7f156c0b7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:34.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.399+0000 7f157232a640 1 --2- 172.21.15.17:0/915148036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f156c0b77d0 0x7f156c0b7c80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1564007d20 tx=0x7f156400e4b0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.399+0000 7f157232a640 1 -- 172.21.15.17:0/915148036 shutdown_connections 2024-04-17T02:22:34.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.399+0000 7f157232a640 1 --2- 172.21.15.17:0/915148036 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f155809f400 0x7f15580a18c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.399+0000 7f157232a640 1 --2- 172.21.15.17:0/915148036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f156c0b77d0 0x7f156c0b7c80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.399+0000 7f157232a640 1 --2- 172.21.15.17:0/915148036 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f156c0aa940 0x7f156c06e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.399+0000 7f157232a640 1 --2- 172.21.15.17:0/915148036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f156c0a84d0 0x7f156c0b9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.399+0000 7f157232a640 1 -- 172.21.15.17:0/915148036 >> 172.21.15.17:0/915148036 conn(0x7f156c0746a0 msgr2=0x7f156c1444e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:34.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.399+0000 7f157232a640 1 -- 172.21.15.17:0/915148036 shutdown_connections 2024-04-17T02:22:34.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.399+0000 7f157232a640 1 -- 172.21.15.17:0/915148036 wait complete. 2024-04-17T02:22:34.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.400+0000 7f1128b7a640 1 -- 172.21.15.17:0/3014867962 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f1124072600 con 0x7f11240a7f70 2024-04-17T02:22:34.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.400+0000 7f111affd640 1 -- 172.21.15.17:0/3014867962 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f11140ba8f0 con 0x7f11240a7f70 2024-04-17T02:22:34.402 INFO:teuthology.orchestra.run.smithi017.stdout:38654705672 2024-04-17T02:22:34.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.403+0000 7f1128b7a640 10 mgrc shutdown 2024-04-17T02:22:34.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.403+0000 7f1128b7a640 1 -- 172.21.15.17:0/3014867962 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f110409f550 msgr2=0x7f11040a1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:34.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.403+0000 7f1128b7a640 1 --2- 172.21.15.17:0/3014867962 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f110409f550 0x7f11040a1a10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f112406f090 tx=0x7f110c009060 comp rx=0 tx=0).stop 2024-04-17T02:22:34.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.403+0000 7f1128b7a640 1 -- 172.21.15.17:0/3014867962 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f11240a7f70 msgr2=0x7f11241d1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:34.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.403+0000 7f1128b7a640 1 --2- 172.21.15.17:0/3014867962 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f11240a7f70 0x7f11241d1cf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1114000c00 tx=0x7f11140046c0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.403+0000 7f1128b7a640 1 -- 172.21.15.17:0/3014867962 shutdown_connections 2024-04-17T02:22:34.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.403+0000 7f1128b7a640 1 --2- 172.21.15.17:0/3014867962 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f110409f550 0x7f11040a1a10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.403+0000 7f1128b7a640 1 --2- 172.21.15.17:0/3014867962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f112413b990 0x7f11240b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.403+0000 7f1128b7a640 1 --2- 172.21.15.17:0/3014867962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1124148d90 0x7f11240b7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.403+0000 7f1128b7a640 1 --2- 172.21.15.17:0/3014867962 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f11240a7f70 0x7f11241d1cf0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.403+0000 7f1128b7a640 1 -- 172.21.15.17:0/3014867962 >> 172.21.15.17:0/3014867962 conn(0x7f11240741a0 msgr2=0x7f112406e860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:34.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.403+0000 7f1128b7a640 1 -- 172.21.15.17:0/3014867962 shutdown_connections 2024-04-17T02:22:34.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.403+0000 7f1128b7a640 1 -- 172.21.15.17:0/3014867962 wait complete. 2024-04-17T02:22:34.413 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.2 2024-04-17T02:22:34.413 DEBUG:teuthology.parallel:result is None 2024-04-17T02:22:34.416 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.1 2024-04-17T02:22:34.416 DEBUG:teuthology.parallel:result is None 2024-04-17T02:22:34.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.434+0000 7f98ac5bf640 1 -- 172.21.15.17:0/3710817071 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f98a40ab0e0 con 0x7f98a4144bc0 2024-04-17T02:22:34.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.434+0000 7f09185e6640 1 -- 172.21.15.17:0/3423275108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f0910073250 con 0x7f09100bb460 2024-04-17T02:22:34.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.435+0000 7f989affd640 1 -- 172.21.15.17:0/3710817071 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f98a40ab0e0 con 0x7f98a4144bc0 2024-04-17T02:22:34.436 INFO:teuthology.orchestra.run.smithi017.stdout:38654705672 2024-04-17T02:22:34.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.435+0000 7f0906ffd640 1 -- 172.21.15.17:0/3423275108 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f090009c140 con 0x7f09100bb460 2024-04-17T02:22:34.436 INFO:teuthology.orchestra.run.smithi017.stdout:38654705672 2024-04-17T02:22:34.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.437+0000 7f98ac5bf640 10 mgrc shutdown 2024-04-17T02:22:34.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.437+0000 7f98ac5bf640 1 -- 172.21.15.17:0/3710817071 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f988809f480 msgr2=0x7f98880a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:34.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.437+0000 7f98ac5bf640 1 --2- 172.21.15.17:0/3710817071 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f988809f480 0x7f98880a1940 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f98a0009f80 tx=0x7f98a0009190 comp rx=0 tx=0).stop 2024-04-17T02:22:34.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.437+0000 7f98ac5bf640 1 -- 172.21.15.17:0/3710817071 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f98a4144bc0 msgr2=0x7f98a41db020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:34.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.437+0000 7f98ac5bf640 1 --2- 172.21.15.17:0/3710817071 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f98a4144bc0 0x7f98a41db020 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f989c00efc0 tx=0x7f989c00c490 comp rx=0 tx=0).stop 2024-04-17T02:22:34.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.437+0000 7f09185e6640 10 mgrc shutdown 2024-04-17T02:22:34.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.437+0000 7f98ac5bf640 1 -- 172.21.15.17:0/3710817071 shutdown_connections 2024-04-17T02:22:34.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.437+0000 7f09185e6640 1 -- 172.21.15.17:0/3423275108 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f08f409f480 msgr2=0x7f08f40a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:34.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.437+0000 7f09185e6640 1 --2- 172.21.15.17:0/3423275108 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f08f409f480 0x7f08f40a1940 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f090c000c00 tx=0x7f090c007d70 comp rx=0 tx=0).stop 2024-04-17T02:22:34.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.437+0000 7f09185e6640 1 -- 172.21.15.17:0/3423275108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09100bb460 msgr2=0x7f0910147c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:34.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.437+0000 7f09185e6640 1 --2- 172.21.15.17:0/3423275108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09100bb460 0x7f0910147c90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f090000e8d0 tx=0x7f090000ed90 comp rx=0 tx=0).stop 2024-04-17T02:22:34.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.437+0000 7f98ac5bf640 1 --2- 172.21.15.17:0/3710817071 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f988809f480 0x7f98880a1940 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.437+0000 7f98ac5bf640 1 --2- 172.21.15.17:0/3710817071 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f98a4144bc0 0x7f98a41db020 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.437+0000 7f98ac5bf640 1 --2- 172.21.15.17:0/3710817071 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98a40a8530 0x7f98a4148b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.437+0000 7f98ac5bf640 1 --2- 172.21.15.17:0/3710817071 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98a40a7200 0x7f98a409ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.437+0000 7f98ac5bf640 1 -- 172.21.15.17:0/3710817071 >> 172.21.15.17:0/3710817071 conn(0x7f98a40746d0 msgr2=0x7f98a4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:34.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.437+0000 7f09185e6640 1 -- 172.21.15.17:0/3423275108 shutdown_connections 2024-04-17T02:22:34.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.437+0000 7f09185e6640 1 --2- 172.21.15.17:0/3423275108 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f08f409f480 0x7f08f40a1940 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.437+0000 7f09185e6640 1 --2- 172.21.15.17:0/3423275108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09100bb460 0x7f0910147c90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.437+0000 7f09185e6640 1 --2- 172.21.15.17:0/3423275108 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f0910142ac0 0x7f0910145bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.437+0000 7f09185e6640 1 --2- 172.21.15.17:0/3423275108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09100ab5b0 0x7f091013e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.437+0000 7f09185e6640 1 -- 172.21.15.17:0/3423275108 >> 172.21.15.17:0/3423275108 conn(0x7f09100ba940 msgr2=0x7f09100a76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:34.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.437+0000 7f98ac5bf640 1 -- 172.21.15.17:0/3710817071 shutdown_connections 2024-04-17T02:22:34.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.437+0000 7f98ac5bf640 1 -- 172.21.15.17:0/3710817071 wait complete. 2024-04-17T02:22:34.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.437+0000 7f09185e6640 1 -- 172.21.15.17:0/3423275108 shutdown_connections 2024-04-17T02:22:34.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.437+0000 7f09185e6640 1 -- 172.21.15.17:0/3423275108 wait complete. 2024-04-17T02:22:34.442 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T02:22:34.444 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T02:22:34.450 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.0 2024-04-17T02:22:34.450 DEBUG:teuthology.parallel:result is None 2024-04-17T02:22:34.450 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.3 2024-04-17T02:22:34.451 DEBUG:teuthology.parallel:result is None 2024-04-17T02:22:34.451 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-17T02:22:34.451 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T02:22:34.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.593+0000 7f6b5e7cd640 1 Processor -- start 2024-04-17T02:22:34.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.593+0000 7f6b5e7cd640 1 -- start start 2024-04-17T02:22:34.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.593+0000 7f6b5e7cd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6b5813b540 0x7f6b58148f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:34.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.593+0000 7f6b5e7cd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6b580a9c00 0x7f6b580aa090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:34.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.593+0000 7f6b5e7cd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b58148870 con 0x7f6b580b8e30 2024-04-17T02:22:34.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.593+0000 7f6b5e7cd640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f6b580b9210 con 0x7f6b580a9c00 2024-04-17T02:22:34.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.593+0000 7f6b5e7cd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f6b5813bc90 con 0x7f6b5813b540 2024-04-17T02:22:34.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.594+0000 7f6b5cd6a640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6b580a9c00 0x7f6b580aa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:34.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.594+0000 7f6b5cd6a640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6b580a9c00 0x7f6b580aa090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52550/0 (socket says 172.21.15.17:52550) 2024-04-17T02:22:34.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.594+0000 7f6b5cd6a640 1 -- 172.21.15.17:0/3771848233 learned_addr learned my addr 172.21.15.17:0/3771848233 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:34.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.594+0000 7f6b5cd6a640 1 -- 172.21.15.17:0/3771848233 >> v2:172.21.15.122:3300/0 conn(0x7f6b5813b540 msgr2=0x7f6b58148f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:34.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.594+0000 7f6b5cd6a640 1 --2- 172.21.15.17:0/3771848233 >> v2:172.21.15.122:3300/0 conn(0x7f6b5813b540 0x7f6b58148f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.594+0000 7f6b5cd6a640 1 -- 172.21.15.17:0/3771848233 >> v1:172.21.15.122:6789/0 conn(0x7f6b580b8e30 legacy=0x7f6b580aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:34.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.594+0000 7f6b5cd6a640 1 -- 172.21.15.17:0/3771848233 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b58149490 con 0x7f6b580a9c00 2024-04-17T02:22:34.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.594+0000 7f6b5cd6a640 1 --2- 172.21.15.17:0/3771848233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b580a9c00 0x7f6b580aa090 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6b580b9a10 tx=0x7f6b5002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb2fc7468ecb7b13 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:34.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.595+0000 7f6b577fe640 1 -- 172.21.15.17:0/3771848233 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5002c9f0 con 0x7f6b580a9c00 2024-04-17T02:22:34.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.595+0000 7f6b577fe640 1 -- 172.21.15.17:0/3771848233 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b5002cb90 con 0x7f6b580a9c00 2024-04-17T02:22:34.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.595+0000 7f6b577fe640 1 -- 172.21.15.17:0/3771848233 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b500343f0 con 0x7f6b580a9c00 2024-04-17T02:22:34.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.595+0000 7f6b5e7cd640 1 -- 172.21.15.17:0/3771848233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b580a9c00 msgr2=0x7f6b580aa090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:34.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.595+0000 7f6b5e7cd640 1 --2- 172.21.15.17:0/3771848233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b580a9c00 0x7f6b580aa090 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6b580b9a10 tx=0x7f6b5002be50 comp rx=0 tx=0).stop 2024-04-17T02:22:34.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.595+0000 7f6b5e7cd640 1 -- 172.21.15.17:0/3771848233 shutdown_connections 2024-04-17T02:22:34.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.595+0000 7f6b5e7cd640 1 --2- 172.21.15.17:0/3771848233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b580a9c00 0x7f6b580aa090 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.595+0000 7f6b5e7cd640 1 --2- 172.21.15.17:0/3771848233 >> v2:172.21.15.122:3300/0 conn(0x7f6b5813b540 0x7f6b58148f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.595+0000 7f6b5e7cd640 1 -- 172.21.15.17:0/3771848233 >> 172.21.15.17:0/3771848233 conn(0x7f6b580741a0 msgr2=0x7f6b580745b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:34.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.595+0000 7f6b5e7cd640 1 -- 172.21.15.17:0/3771848233 shutdown_connections 2024-04-17T02:22:34.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.595+0000 7f6b5e7cd640 1 -- 172.21.15.17:0/3771848233 wait complete. 2024-04-17T02:22:34.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.596+0000 7f6b5e7cd640 1 Processor -- start 2024-04-17T02:22:34.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.596+0000 7f6b5e7cd640 1 -- start start 2024-04-17T02:22:34.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.597+0000 7f6b5e7cd640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f6b580a9c00 0x7f6b5812f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:34.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.597+0000 7f6b5e7cd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b580b8e30 0x7f6b580b5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:34.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.597+0000 7f6b5e7cd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b5813b540 0x7f6b58139fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:34.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.597+0000 7f6b5e7cd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6b5814fdb0 con 0x7f6b580b8e30 2024-04-17T02:22:34.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.597+0000 7f6b5e7cd640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6b5814fc30 con 0x7f6b5813b540 2024-04-17T02:22:34.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.597+0000 7f6b5e7cd640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f6b5814ff30 con 0x7f6b580a9c00 2024-04-17T02:22:34.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.597+0000 7f6b4ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b580b8e30 0x7f6b580b5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:34.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.597+0000 7f6b57fff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f6b580a9c00 0x7f6b5812f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:34.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.597+0000 7f6b57fff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f6b580a9c00 0x7f6b5812f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:53158/0 (socket says 172.21.15.17:53158) 2024-04-17T02:22:34.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.597+0000 7f6b4ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b580b8e30 0x7f6b580b5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52562/0 (socket says 172.21.15.17:52562) 2024-04-17T02:22:34.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.597+0000 7f6b57fff640 1 -- 172.21.15.17:0/70119488 learned_addr learned my addr 172.21.15.17:0/70119488 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:34.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.597+0000 7f6b5cd6a640 1 --2- 172.21.15.17:0/70119488 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b5813b540 0x7f6b58139fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:34.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.597+0000 7f6b57fff640 1 -- 172.21.15.17:0/70119488 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b5813b540 msgr2=0x7f6b58139fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:34.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.597+0000 7f6b57fff640 1 --2- 172.21.15.17:0/70119488 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b5813b540 0x7f6b58139fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.597+0000 7f6b57fff640 1 -- 172.21.15.17:0/70119488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b580b8e30 msgr2=0x7f6b580b5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:34.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.597+0000 7f6b57fff640 1 --2- 172.21.15.17:0/70119488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b580b8e30 0x7f6b580b5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.597+0000 7f6b57fff640 1 -- 172.21.15.17:0/70119488 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b5812fa20 con 0x7f6b580a9c00 2024-04-17T02:22:34.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.597+0000 7f6b4ffff640 1 --2- 172.21.15.17:0/70119488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b580b8e30 0x7f6b580b5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:34.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.598+0000 7f6b57fff640 1 --2- 172.21.15.17:0/70119488 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f6b580a9c00 0x7f6b5812f390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6b4800c410 tx=0x7f6b4800c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:34.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.598+0000 7f6b557fa640 1 -- 172.21.15.17:0/70119488 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b48017070 con 0x7f6b580a9c00 2024-04-17T02:22:34.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.598+0000 7f6b557fa640 1 -- 172.21.15.17:0/70119488 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b480035f0 con 0x7f6b580a9c00 2024-04-17T02:22:34.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.598+0000 7f6b5e7cd640 1 -- 172.21.15.17:0/70119488 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b5812fce0 con 0x7f6b580a9c00 2024-04-17T02:22:34.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.598+0000 7f6b557fa640 1 -- 172.21.15.17:0/70119488 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b480039e0 con 0x7f6b580a9c00 2024-04-17T02:22:34.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.598+0000 7f6b5e7cd640 1 -- 172.21.15.17:0/70119488 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b580b2d80 con 0x7f6b580a9c00 2024-04-17T02:22:34.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.599+0000 7f6b5e7cd640 1 -- 172.21.15.17:0/70119488 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b580687f0 con 0x7f6b580a9c00 2024-04-17T02:22:34.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.600+0000 7f6b557fa640 1 -- 172.21.15.17:0/70119488 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f6b4801a070 con 0x7f6b580a9c00 2024-04-17T02:22:34.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.600+0000 7f6b557fa640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:34.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.600+0000 7f6b557fa640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:34.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.600+0000 7f6b557fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:34.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.600+0000 7f6b557fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:34.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.600+0000 7f6b557fa640 1 --2- 172.21.15.17:0/70119488 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f6b3809f4b0 0x7f6b380a1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:34.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.601+0000 7f6b4ffff640 1 --2- 172.21.15.17:0/70119488 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f6b3809f4b0 0x7f6b380a1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:34.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.601+0000 7f6b557fa640 1 -- 172.21.15.17:0/70119488 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f6b480c8c90 con 0x7f6b580a9c00 2024-04-17T02:22:34.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.601+0000 7f6b4ffff640 1 --2- 172.21.15.17:0/70119488 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f6b3809f4b0 0x7f6b380a1970 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6b5812ff70 tx=0x7f6b40009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:34.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.604+0000 7f6b557fa640 1 -- 172.21.15.17:0/70119488 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f6b48021020 con 0x7f6b580a9c00 2024-04-17T02:22:34.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.782+0000 7f6b5e7cd640 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2024-04-17T02:22:34.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.782+0000 7f6b5e7cd640 1 -- 172.21.15.17:0/70119488 --> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6b580a8ad0 con 0x7f6b3809f4b0 2024-04-17T02:22:34.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.788+0000 7f6b557fa640 1 -- 172.21.15.17:0/70119488 <== mgr.4103 v2:172.21.15.17:6808/563692809 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+268617 (secure 0 0 0) 0x7f6b580a8ad0 con 0x7f6b3809f4b0 2024-04-17T02:22:34.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.788+0000 7f6b557fa640 20 mgrc handle_command_reply tid 0 r 0 2024-04-17T02:22:34.795 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:22:34.797 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-04-17T02:22:34.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.791+0000 7f6b5e7cd640 10 mgrc shutdown 2024-04-17T02:22:34.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.791+0000 7f6b5e7cd640 1 -- 172.21.15.17:0/70119488 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f6b3809f4b0 msgr2=0x7f6b380a1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:34.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.791+0000 7f6b5e7cd640 1 --2- 172.21.15.17:0/70119488 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f6b3809f4b0 0x7f6b380a1970 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6b5812ff70 tx=0x7f6b40009060 comp rx=0 tx=0).stop 2024-04-17T02:22:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.791+0000 7f6b5e7cd640 1 -- 172.21.15.17:0/70119488 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f6b580a9c00 msgr2=0x7f6b5812f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.791+0000 7f6b5e7cd640 1 --2- 172.21.15.17:0/70119488 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f6b580a9c00 0x7f6b5812f390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6b4800c410 tx=0x7f6b4800c8d0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.791+0000 7f6b5e7cd640 1 -- 172.21.15.17:0/70119488 shutdown_connections 2024-04-17T02:22:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.791+0000 7f6b5e7cd640 1 --2- 172.21.15.17:0/70119488 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f6b3809f4b0 0x7f6b380a1970 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.791+0000 7f6b5e7cd640 1 --2- 172.21.15.17:0/70119488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b580b8e30 0x7f6b580b5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.791+0000 7f6b5e7cd640 1 --2- 172.21.15.17:0/70119488 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b5813b540 0x7f6b58139fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.791+0000 7f6b5e7cd640 1 --2- 172.21.15.17:0/70119488 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f6b580a9c00 0x7f6b5812f390 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.791+0000 7f6b5e7cd640 1 -- 172.21.15.17:0/70119488 >> 172.21.15.17:0/70119488 conn(0x7f6b580741a0 msgr2=0x7f6b58072220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:34.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.791+0000 7f6b5e7cd640 1 -- 172.21.15.17:0/70119488 shutdown_connections 2024-04-17T02:22:34.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.791+0000 7f6b5e7cd640 1 -- 172.21.15.17:0/70119488 wait complete. 2024-04-17T02:22:34.805 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-04-17T02:22:34.506846+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":113176,"kb_used_data":912,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377374184,"statfs":{"total":386547056640,"available":386431164416,"internally_reserved":0,"allocated":933888,"data_stored":1439892,"data_compressed":65024,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":6377,"internal_metadata":114878231},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.263851"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247513+0000","last_change":"2024-04-17T02:22:22.259104+0000","last_active":"2024-04-17T02:22:23.247513+0000","last_peered":"2024-04-17T02:22:23.247513+0000","last_clean":"2024-04-17T02:22:23.247513+0000","last_became_active":"2024-04-17T02:22:22.258830+0000","last_became_peered":"2024-04-17T02:22:22.258830+0000","last_unstale":"2024-04-17T02:22:23.247513+0000","last_undegraded":"2024-04-17T02:22:23.247513+0000","last_fullsized":"2024-04-17T02:22:23.247513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:42:09.532783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245851+0000","last_change":"2024-04-17T02:22:22.274708+0000","last_active":"2024-04-17T02:22:23.245851+0000","last_peered":"2024-04-17T02:22:23.245851+0000","last_clean":"2024-04-17T02:22:23.245851+0000","last_became_active":"2024-04-17T02:22:22.274397+0000","last_became_peered":"2024-04-17T02:22:22.274397+0000","last_unstale":"2024-04-17T02:22:23.245851+0000","last_undegraded":"2024-04-17T02:22:23.245851+0000","last_fullsized":"2024-04-17T02:22:23.245851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:04:31.488847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245739+0000","last_change":"2024-04-17T02:22:22.257081+0000","last_active":"2024-04-17T02:22:23.245739+0000","last_peered":"2024-04-17T02:22:23.245739+0000","last_clean":"2024-04-17T02:22:23.245739+0000","last_became_active":"2024-04-17T02:22:22.256695+0000","last_became_peered":"2024-04-17T02:22:22.256695+0000","last_unstale":"2024-04-17T02:22:23.245739+0000","last_undegraded":"2024-04-17T02:22:23.245739+0000","last_fullsized":"2024-04-17T02:22:23.245739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:52:02.173760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962692+0000","last_change":"2024-04-17T02:22:22.272106+0000","last_active":"2024-04-17T02:22:23.962692+0000","last_peered":"2024-04-17T02:22:23.962692+0000","last_clean":"2024-04-17T02:22:23.962692+0000","last_became_active":"2024-04-17T02:22:22.271074+0000","last_became_peered":"2024-04-17T02:22:22.271074+0000","last_unstale":"2024-04-17T02:22:23.962692+0000","last_undegraded":"2024-04-17T02:22:23.962692+0000","last_fullsized":"2024-04-17T02:22:23.962692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:45:41.860323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248355+0000","last_change":"2024-04-17T02:22:22.258839+0000","last_active":"2024-04-17T02:22:23.248355+0000","last_peered":"2024-04-17T02:22:23.248355+0000","last_clean":"2024-04-17T02:22:23.248355+0000","last_became_active":"2024-04-17T02:22:22.257715+0000","last_became_peered":"2024-04-17T02:22:22.257715+0000","last_unstale":"2024-04-17T02:22:23.248355+0000","last_undegraded":"2024-04-17T02:22:23.248355+0000","last_fullsized":"2024-04-17T02:22:23.248355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:26:13.695328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247496+0000","last_change":"2024-04-17T02:22:22.259395+0000","last_active":"2024-04-17T02:22:23.247496+0000","last_peered":"2024-04-17T02:22:23.247496+0000","last_clean":"2024-04-17T02:22:23.247496+0000","last_became_active":"2024-04-17T02:22:22.258508+0000","last_became_peered":"2024-04-17T02:22:22.258508+0000","last_unstale":"2024-04-17T02:22:23.247496+0000","last_undegraded":"2024-04-17T02:22:23.247496+0000","last_fullsized":"2024-04-17T02:22:23.247496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:34:29.435312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248096+0000","last_change":"2024-04-17T02:22:22.261760+0000","last_active":"2024-04-17T02:22:23.248096+0000","last_peered":"2024-04-17T02:22:23.248096+0000","last_clean":"2024-04-17T02:22:23.248096+0000","last_became_active":"2024-04-17T02:22:22.261501+0000","last_became_peered":"2024-04-17T02:22:22.261501+0000","last_unstale":"2024-04-17T02:22:23.248096+0000","last_undegraded":"2024-04-17T02:22:23.248096+0000","last_fullsized":"2024-04-17T02:22:23.248096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:07:20.363260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.244553+0000","last_change":"2024-04-17T02:22:22.257716+0000","last_active":"2024-04-17T02:22:23.244553+0000","last_peered":"2024-04-17T02:22:23.244553+0000","last_clean":"2024-04-17T02:22:23.244553+0000","last_became_active":"2024-04-17T02:22:22.257354+0000","last_became_peered":"2024-04-17T02:22:22.257354+0000","last_unstale":"2024-04-17T02:22:23.244553+0000","last_undegraded":"2024-04-17T02:22:23.244553+0000","last_fullsized":"2024-04-17T02:22:23.244553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:45:35.746928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247533+0000","last_change":"2024-04-17T02:22:22.261339+0000","last_active":"2024-04-17T02:22:23.247533+0000","last_peered":"2024-04-17T02:22:23.247533+0000","last_clean":"2024-04-17T02:22:23.247533+0000","last_became_active":"2024-04-17T02:22:22.258124+0000","last_became_peered":"2024-04-17T02:22:22.258124+0000","last_unstale":"2024-04-17T02:22:23.247533+0000","last_undegraded":"2024-04-17T02:22:23.247533+0000","last_fullsized":"2024-04-17T02:22:23.247533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:31:34.863748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962968+0000","last_change":"2024-04-17T02:22:22.276919+0000","last_active":"2024-04-17T02:22:23.962968+0000","last_peered":"2024-04-17T02:22:23.962968+0000","last_clean":"2024-04-17T02:22:23.962968+0000","last_became_active":"2024-04-17T02:22:22.273911+0000","last_became_peered":"2024-04-17T02:22:22.273911+0000","last_unstale":"2024-04-17T02:22:23.962968+0000","last_undegraded":"2024-04-17T02:22:23.962968+0000","last_fullsized":"2024-04-17T02:22:23.962968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:33:01.850142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962960+0000","last_change":"2024-04-17T02:22:22.269997+0000","last_active":"2024-04-17T02:22:23.962960+0000","last_peered":"2024-04-17T02:22:23.962960+0000","last_clean":"2024-04-17T02:22:23.962960+0000","last_became_active":"2024-04-17T02:22:22.269071+0000","last_became_peered":"2024-04-17T02:22:22.269071+0000","last_unstale":"2024-04-17T02:22:23.962960+0000","last_undegraded":"2024-04-17T02:22:23.962960+0000","last_fullsized":"2024-04-17T02:22:23.962960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:28:17.292009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246781+0000","last_change":"2024-04-17T02:22:22.255449+0000","last_active":"2024-04-17T02:22:23.246781+0000","last_peered":"2024-04-17T02:22:23.246781+0000","last_clean":"2024-04-17T02:22:23.246781+0000","last_became_active":"2024-04-17T02:22:22.254619+0000","last_became_peered":"2024-04-17T02:22:22.254619+0000","last_unstale":"2024-04-17T02:22:23.246781+0000","last_undegraded":"2024-04-17T02:22:23.246781+0000","last_fullsized":"2024-04-17T02:22:23.246781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:29:09.389819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246450+0000","last_change":"2024-04-17T02:22:22.257767+0000","last_active":"2024-04-17T02:22:23.246450+0000","last_peered":"2024-04-17T02:22:23.246450+0000","last_clean":"2024-04-17T02:22:23.246450+0000","last_became_active":"2024-04-17T02:22:22.257506+0000","last_became_peered":"2024-04-17T02:22:22.257506+0000","last_unstale":"2024-04-17T02:22:23.246450+0000","last_undegraded":"2024-04-17T02:22:23.246450+0000","last_fullsized":"2024-04-17T02:22:23.246450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:36:11.795618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245156+0000","last_change":"2024-04-17T02:22:22.254083+0000","last_active":"2024-04-17T02:22:23.245156+0000","last_peered":"2024-04-17T02:22:23.245156+0000","last_clean":"2024-04-17T02:22:23.245156+0000","last_became_active":"2024-04-17T02:22:22.253756+0000","last_became_peered":"2024-04-17T02:22:22.253756+0000","last_unstale":"2024-04-17T02:22:23.245156+0000","last_undegraded":"2024-04-17T02:22:23.245156+0000","last_fullsized":"2024-04-17T02:22:23.245156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:55:12.334737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.244837+0000","last_change":"2024-04-17T02:22:22.269407+0000","last_active":"2024-04-17T02:22:23.244837+0000","last_peered":"2024-04-17T02:22:23.244837+0000","last_clean":"2024-04-17T02:22:23.244837+0000","last_became_active":"2024-04-17T02:22:22.269130+0000","last_became_peered":"2024-04-17T02:22:22.269130+0000","last_unstale":"2024-04-17T02:22:23.244837+0000","last_undegraded":"2024-04-17T02:22:23.244837+0000","last_fullsized":"2024-04-17T02:22:23.244837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:44:17.761493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.244638+0000","last_change":"2024-04-17T02:22:22.257257+0000","last_active":"2024-04-17T02:22:23.244638+0000","last_peered":"2024-04-17T02:22:23.244638+0000","last_clean":"2024-04-17T02:22:23.244638+0000","last_became_active":"2024-04-17T02:22:22.256498+0000","last_became_peered":"2024-04-17T02:22:22.256498+0000","last_unstale":"2024-04-17T02:22:23.244638+0000","last_undegraded":"2024-04-17T02:22:23.244638+0000","last_fullsized":"2024-04-17T02:22:23.244638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:09:57.616528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963373+0000","last_change":"2024-04-17T02:22:22.273771+0000","last_active":"2024-04-17T02:22:23.963373+0000","last_peered":"2024-04-17T02:22:23.963373+0000","last_clean":"2024-04-17T02:22:23.963373+0000","last_became_active":"2024-04-17T02:22:22.273403+0000","last_became_peered":"2024-04-17T02:22:22.273403+0000","last_unstale":"2024-04-17T02:22:23.963373+0000","last_undegraded":"2024-04-17T02:22:23.963373+0000","last_fullsized":"2024-04-17T02:22:23.963373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:43:59.776760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248116+0000","last_change":"2024-04-17T02:22:22.258817+0000","last_active":"2024-04-17T02:22:23.248116+0000","last_peered":"2024-04-17T02:22:23.248116+0000","last_clean":"2024-04-17T02:22:23.248116+0000","last_became_active":"2024-04-17T02:22:22.258461+0000","last_became_peered":"2024-04-17T02:22:22.258461+0000","last_unstale":"2024-04-17T02:22:23.248116+0000","last_undegraded":"2024-04-17T02:22:23.248116+0000","last_fullsized":"2024-04-17T02:22:23.248116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:24:39.123134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246891+0000","last_change":"2024-04-17T02:22:22.260864+0000","last_active":"2024-04-17T02:22:23.246891+0000","last_peered":"2024-04-17T02:22:23.246891+0000","last_clean":"2024-04-17T02:22:23.246891+0000","last_became_active":"2024-04-17T02:22:22.260605+0000","last_became_peered":"2024-04-17T02:22:22.260605+0000","last_unstale":"2024-04-17T02:22:23.246891+0000","last_undegraded":"2024-04-17T02:22:23.246891+0000","last_fullsized":"2024-04-17T02:22:23.246891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:24:43.421842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962806+0000","last_change":"2024-04-17T02:22:22.271849+0000","last_active":"2024-04-17T02:22:23.962806+0000","last_peered":"2024-04-17T02:22:23.962806+0000","last_clean":"2024-04-17T02:22:23.962806+0000","last_became_active":"2024-04-17T02:22:22.270030+0000","last_became_peered":"2024-04-17T02:22:22.270030+0000","last_unstale":"2024-04-17T02:22:23.962806+0000","last_undegraded":"2024-04-17T02:22:23.962806+0000","last_fullsized":"2024-04-17T02:22:23.962806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:26:13.695328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245164+0000","last_change":"2024-04-17T02:22:22.255249+0000","last_active":"2024-04-17T02:22:23.245164+0000","last_peered":"2024-04-17T02:22:23.245164+0000","last_clean":"2024-04-17T02:22:23.245164+0000","last_became_active":"2024-04-17T02:22:22.254964+0000","last_became_peered":"2024-04-17T02:22:22.254964+0000","last_unstale":"2024-04-17T02:22:23.245164+0000","last_undegraded":"2024-04-17T02:22:23.245164+0000","last_fullsized":"2024-04-17T02:22:23.245164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:08:08.804961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962272+0000","last_change":"2024-04-17T02:22:22.277803+0000","last_active":"2024-04-17T02:22:23.962272+0000","last_peered":"2024-04-17T02:22:23.962272+0000","last_clean":"2024-04-17T02:22:23.962272+0000","last_became_active":"2024-04-17T02:22:22.277509+0000","last_became_peered":"2024-04-17T02:22:22.277509+0000","last_unstale":"2024-04-17T02:22:23.962272+0000","last_undegraded":"2024-04-17T02:22:23.962272+0000","last_fullsized":"2024-04-17T02:22:23.962272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:40:01.962151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248329+0000","last_change":"2024-04-17T02:22:22.274201+0000","last_active":"2024-04-17T02:22:23.248329+0000","last_peered":"2024-04-17T02:22:23.248329+0000","last_clean":"2024-04-17T02:22:23.248329+0000","last_became_active":"2024-04-17T02:22:22.273832+0000","last_became_peered":"2024-04-17T02:22:22.273832+0000","last_unstale":"2024-04-17T02:22:23.248329+0000","last_undegraded":"2024-04-17T02:22:23.248329+0000","last_fullsized":"2024-04-17T02:22:23.248329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:45:41.860323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.244683+0000","last_change":"2024-04-17T02:22:22.250494+0000","last_active":"2024-04-17T02:22:23.244683+0000","last_peered":"2024-04-17T02:22:23.244683+0000","last_clean":"2024-04-17T02:22:23.244683+0000","last_became_active":"2024-04-17T02:22:22.250080+0000","last_became_peered":"2024-04-17T02:22:22.250080+0000","last_unstale":"2024-04-17T02:22:23.244683+0000","last_undegraded":"2024-04-17T02:22:23.244683+0000","last_fullsized":"2024-04-17T02:22:23.244683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:35:24.036979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963005+0000","last_change":"2024-04-17T02:22:22.274842+0000","last_active":"2024-04-17T02:22:23.963005+0000","last_peered":"2024-04-17T02:22:23.963005+0000","last_clean":"2024-04-17T02:22:23.963005+0000","last_became_active":"2024-04-17T02:22:22.273726+0000","last_became_peered":"2024-04-17T02:22:22.273726+0000","last_unstale":"2024-04-17T02:22:23.963005+0000","last_undegraded":"2024-04-17T02:22:23.963005+0000","last_fullsized":"2024-04-17T02:22:23.963005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:45:35.746928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963211+0000","last_change":"2024-04-17T02:22:22.273623+0000","last_active":"2024-04-17T02:22:23.963211+0000","last_peered":"2024-04-17T02:22:23.963211+0000","last_clean":"2024-04-17T02:22:23.963211+0000","last_became_active":"2024-04-17T02:22:22.273324+0000","last_became_peered":"2024-04-17T02:22:22.273324+0000","last_unstale":"2024-04-17T02:22:23.963211+0000","last_undegraded":"2024-04-17T02:22:23.963211+0000","last_fullsized":"2024-04-17T02:22:23.963211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:55:12.334737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246237+0000","last_change":"2024-04-17T02:22:22.259990+0000","last_active":"2024-04-17T02:22:23.246237+0000","last_peered":"2024-04-17T02:22:23.246237+0000","last_clean":"2024-04-17T02:22:23.246237+0000","last_became_active":"2024-04-17T02:22:22.259635+0000","last_became_peered":"2024-04-17T02:22:22.259635+0000","last_unstale":"2024-04-17T02:22:23.246237+0000","last_undegraded":"2024-04-17T02:22:23.246237+0000","last_fullsized":"2024-04-17T02:22:23.246237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:38:51.312268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963321+0000","last_change":"2024-04-17T02:22:22.269783+0000","last_active":"2024-04-17T02:22:23.963321+0000","last_peered":"2024-04-17T02:22:23.963321+0000","last_clean":"2024-04-17T02:22:23.963321+0000","last_became_active":"2024-04-17T02:22:22.269006+0000","last_became_peered":"2024-04-17T02:22:22.269006+0000","last_unstale":"2024-04-17T02:22:23.963321+0000","last_undegraded":"2024-04-17T02:22:23.963321+0000","last_fullsized":"2024-04-17T02:22:23.963321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:08:08.804961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248147+0000","last_change":"2024-04-17T02:22:22.258194+0000","last_active":"2024-04-17T02:22:23.248147+0000","last_peered":"2024-04-17T02:22:23.248147+0000","last_clean":"2024-04-17T02:22:23.248147+0000","last_became_active":"2024-04-17T02:22:22.257344+0000","last_became_peered":"2024-04-17T02:22:22.257344+0000","last_unstale":"2024-04-17T02:22:23.248147+0000","last_undegraded":"2024-04-17T02:22:23.248147+0000","last_fullsized":"2024-04-17T02:22:23.248147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:12:23.134715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962539+0000","last_change":"2024-04-17T02:22:22.276867+0000","last_active":"2024-04-17T02:22:23.962539+0000","last_peered":"2024-04-17T02:22:23.962539+0000","last_clean":"2024-04-17T02:22:23.962539+0000","last_became_active":"2024-04-17T02:22:22.273911+0000","last_became_peered":"2024-04-17T02:22:22.273911+0000","last_unstale":"2024-04-17T02:22:23.962539+0000","last_undegraded":"2024-04-17T02:22:23.962539+0000","last_fullsized":"2024-04-17T02:22:23.962539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:12:23.134715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248369+0000","last_change":"2024-04-17T02:22:22.274573+0000","last_active":"2024-04-17T02:22:23.248369+0000","last_peered":"2024-04-17T02:22:23.248369+0000","last_clean":"2024-04-17T02:22:23.248369+0000","last_became_active":"2024-04-17T02:22:22.274287+0000","last_became_peered":"2024-04-17T02:22:22.274287+0000","last_unstale":"2024-04-17T02:22:23.248369+0000","last_undegraded":"2024-04-17T02:22:23.248369+0000","last_fullsized":"2024-04-17T02:22:23.248369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:02:38.660756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.244774+0000","last_change":"2024-04-17T02:22:22.249744+0000","last_active":"2024-04-17T02:22:23.244774+0000","last_peered":"2024-04-17T02:22:23.244774+0000","last_clean":"2024-04-17T02:22:23.244774+0000","last_became_active":"2024-04-17T02:22:22.249456+0000","last_became_peered":"2024-04-17T02:22:22.249456+0000","last_unstale":"2024-04-17T02:22:23.244774+0000","last_undegraded":"2024-04-17T02:22:23.244774+0000","last_fullsized":"2024-04-17T02:22:23.244774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:58:55.176237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247534+0000","last_change":"2024-04-17T02:22:22.276822+0000","last_active":"2024-04-17T02:22:23.247534+0000","last_peered":"2024-04-17T02:22:23.247534+0000","last_clean":"2024-04-17T02:22:23.247534+0000","last_became_active":"2024-04-17T02:22:22.276565+0000","last_became_peered":"2024-04-17T02:22:22.276565+0000","last_unstale":"2024-04-17T02:22:23.247534+0000","last_undegraded":"2024-04-17T02:22:23.247534+0000","last_fullsized":"2024-04-17T02:22:23.247534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:00:17.976771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248519+0000","last_change":"2024-04-17T02:22:21.260392+0000","last_active":"2024-04-17T02:22:23.248519+0000","last_peered":"2024-04-17T02:22:23.248519+0000","last_clean":"2024-04-17T02:22:23.248519+0000","last_became_active":"2024-04-17T02:22:21.259347+0000","last_became_peered":"2024-04-17T02:22:21.259347+0000","last_unstale":"2024-04-17T02:22:23.248519+0000","last_undegraded":"2024-04-17T02:22:23.248519+0000","last_fullsized":"2024-04-17T02:22:23.248519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:07:12.265185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248186+0000","last_change":"2024-04-17T02:22:22.260150+0000","last_active":"2024-04-17T02:22:23.248186+0000","last_peered":"2024-04-17T02:22:23.248186+0000","last_clean":"2024-04-17T02:22:23.248186+0000","last_became_active":"2024-04-17T02:22:22.259875+0000","last_became_peered":"2024-04-17T02:22:22.259875+0000","last_unstale":"2024-04-17T02:22:23.248186+0000","last_undegraded":"2024-04-17T02:22:23.248186+0000","last_fullsized":"2024-04-17T02:22:23.248186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:59:56.366536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246343+0000","last_change":"2024-04-17T02:22:21.252345+0000","last_active":"2024-04-17T02:22:23.246343+0000","last_peered":"2024-04-17T02:22:23.246343+0000","last_clean":"2024-04-17T02:22:23.246343+0000","last_became_active":"2024-04-17T02:22:21.252035+0000","last_became_peered":"2024-04-17T02:22:21.252035+0000","last_unstale":"2024-04-17T02:22:23.246343+0000","last_undegraded":"2024-04-17T02:22:23.246343+0000","last_fullsized":"2024-04-17T02:22:23.246343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:00:58.747974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248224+0000","last_change":"2024-04-17T02:22:22.277830+0000","last_active":"2024-04-17T02:22:23.248224+0000","last_peered":"2024-04-17T02:22:23.248224+0000","last_clean":"2024-04-17T02:22:23.248224+0000","last_became_active":"2024-04-17T02:22:22.277558+0000","last_became_peered":"2024-04-17T02:22:22.277558+0000","last_unstale":"2024-04-17T02:22:23.248224+0000","last_undegraded":"2024-04-17T02:22:23.248224+0000","last_fullsized":"2024-04-17T02:22:23.248224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:06:11.399207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.244931+0000","last_change":"2024-04-17T02:22:21.257436+0000","last_active":"2024-04-17T02:22:23.244931+0000","last_peered":"2024-04-17T02:22:23.244931+0000","last_clean":"2024-04-17T02:22:23.244931+0000","last_became_active":"2024-04-17T02:22:21.256912+0000","last_became_peered":"2024-04-17T02:22:21.256912+0000","last_unstale":"2024-04-17T02:22:23.244931+0000","last_undegraded":"2024-04-17T02:22:23.244931+0000","last_fullsized":"2024-04-17T02:22:23.244931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:24:42.419846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248533+0000","last_change":"2024-04-17T02:22:22.278083+0000","last_active":"2024-04-17T02:22:23.248533+0000","last_peered":"2024-04-17T02:22:23.248533+0000","last_clean":"2024-04-17T02:22:23.248533+0000","last_became_active":"2024-04-17T02:22:22.277838+0000","last_became_peered":"2024-04-17T02:22:22.277838+0000","last_unstale":"2024-04-17T02:22:23.248533+0000","last_undegraded":"2024-04-17T02:22:23.248533+0000","last_fullsized":"2024-04-17T02:22:23.248533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:28:17.292009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.244776+0000","last_change":"2024-04-17T02:22:21.264203+0000","last_active":"2024-04-17T02:22:23.244776+0000","last_peered":"2024-04-17T02:22:23.244776+0000","last_clean":"2024-04-17T02:22:23.244776+0000","last_became_active":"2024-04-17T02:22:21.263926+0000","last_became_peered":"2024-04-17T02:22:21.263926+0000","last_unstale":"2024-04-17T02:22:23.244776+0000","last_undegraded":"2024-04-17T02:22:23.244776+0000","last_fullsized":"2024-04-17T02:22:23.244776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:12:51.802467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245897+0000","last_change":"2024-04-17T02:22:21.262253+0000","last_active":"2024-04-17T02:22:23.245897+0000","last_peered":"2024-04-17T02:22:23.245897+0000","last_clean":"2024-04-17T02:22:23.245897+0000","last_became_active":"2024-04-17T02:22:21.261336+0000","last_became_peered":"2024-04-17T02:22:21.261336+0000","last_unstale":"2024-04-17T02:22:23.245897+0000","last_undegraded":"2024-04-17T02:22:23.245897+0000","last_fullsized":"2024-04-17T02:22:23.245897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:20:13.640602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247204+0000","last_change":"2024-04-17T02:22:22.259672+0000","last_active":"2024-04-17T02:22:23.247204+0000","last_peered":"2024-04-17T02:22:23.247204+0000","last_clean":"2024-04-17T02:22:23.247204+0000","last_became_active":"2024-04-17T02:22:22.259407+0000","last_became_peered":"2024-04-17T02:22:22.259407+0000","last_unstale":"2024-04-17T02:22:23.247204+0000","last_undegraded":"2024-04-17T02:22:23.247204+0000","last_fullsized":"2024-04-17T02:22:23.247204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:56:41.058446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246089+0000","last_change":"2024-04-17T02:22:21.251579+0000","last_active":"2024-04-17T02:22:23.246089+0000","last_peered":"2024-04-17T02:22:23.246089+0000","last_clean":"2024-04-17T02:22:23.246089+0000","last_became_active":"2024-04-17T02:22:21.251330+0000","last_became_peered":"2024-04-17T02:22:21.251330+0000","last_unstale":"2024-04-17T02:22:23.246089+0000","last_undegraded":"2024-04-17T02:22:23.246089+0000","last_fullsized":"2024-04-17T02:22:23.246089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:30:22.630029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962294+0000","last_change":"2024-04-17T02:22:22.270839+0000","last_active":"2024-04-17T02:22:23.962294+0000","last_peered":"2024-04-17T02:22:23.962294+0000","last_clean":"2024-04-17T02:22:23.962294+0000","last_became_active":"2024-04-17T02:22:22.268977+0000","last_became_peered":"2024-04-17T02:22:22.268977+0000","last_unstale":"2024-04-17T02:22:23.962294+0000","last_undegraded":"2024-04-17T02:22:23.962294+0000","last_fullsized":"2024-04-17T02:22:23.962294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:07:20.363260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246033+0000","last_change":"2024-04-17T02:22:21.256996+0000","last_active":"2024-04-17T02:22:23.246033+0000","last_peered":"2024-04-17T02:22:23.246033+0000","last_clean":"2024-04-17T02:22:23.246033+0000","last_became_active":"2024-04-17T02:22:21.256082+0000","last_became_peered":"2024-04-17T02:22:21.256082+0000","last_unstale":"2024-04-17T02:22:23.246033+0000","last_undegraded":"2024-04-17T02:22:23.246033+0000","last_fullsized":"2024-04-17T02:22:23.246033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:42:14.419225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245472+0000","last_change":"2024-04-17T02:22:22.258273+0000","last_active":"2024-04-17T02:22:23.245472+0000","last_peered":"2024-04-17T02:22:23.245472+0000","last_clean":"2024-04-17T02:22:23.245472+0000","last_became_active":"2024-04-17T02:22:22.257818+0000","last_became_peered":"2024-04-17T02:22:22.257818+0000","last_unstale":"2024-04-17T02:22:23.245472+0000","last_undegraded":"2024-04-17T02:22:23.245472+0000","last_fullsized":"2024-04-17T02:22:23.245472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:45:43.904195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245616+0000","last_change":"2024-04-17T02:22:21.250003+0000","last_active":"2024-04-17T02:22:23.245616+0000","last_peered":"2024-04-17T02:22:23.245616+0000","last_clean":"2024-04-17T02:22:23.245616+0000","last_became_active":"2024-04-17T02:22:21.249709+0000","last_became_peered":"2024-04-17T02:22:21.249709+0000","last_unstale":"2024-04-17T02:22:23.245616+0000","last_undegraded":"2024-04-17T02:22:23.245616+0000","last_fullsized":"2024-04-17T02:22:23.245616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:56:40.377974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246786+0000","last_change":"2024-04-17T02:22:22.255008+0000","last_active":"2024-04-17T02:22:23.246786+0000","last_peered":"2024-04-17T02:22:23.246786+0000","last_clean":"2024-04-17T02:22:23.246786+0000","last_became_active":"2024-04-17T02:22:22.254689+0000","last_became_peered":"2024-04-17T02:22:22.254689+0000","last_unstale":"2024-04-17T02:22:23.246786+0000","last_undegraded":"2024-04-17T02:22:23.246786+0000","last_fullsized":"2024-04-17T02:22:23.246786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:05:18.321177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248616+0000","last_change":"2024-04-17T02:22:21.265269+0000","last_active":"2024-04-17T02:22:23.248616+0000","last_peered":"2024-04-17T02:22:23.248616+0000","last_clean":"2024-04-17T02:22:23.248616+0000","last_became_active":"2024-04-17T02:22:21.264981+0000","last_became_peered":"2024-04-17T02:22:21.264981+0000","last_unstale":"2024-04-17T02:22:23.248616+0000","last_undegraded":"2024-04-17T02:22:23.248616+0000","last_fullsized":"2024-04-17T02:22:23.248616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:27:52.759868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962935+0000","last_change":"2024-04-17T02:22:22.271981+0000","last_active":"2024-04-17T02:22:23.962935+0000","last_peered":"2024-04-17T02:22:23.962935+0000","last_clean":"2024-04-17T02:22:23.962935+0000","last_became_active":"2024-04-17T02:22:22.270317+0000","last_became_peered":"2024-04-17T02:22:22.270317+0000","last_unstale":"2024-04-17T02:22:23.962935+0000","last_undegraded":"2024-04-17T02:22:23.962935+0000","last_fullsized":"2024-04-17T02:22:23.962935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:02:38.660756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245901+0000","last_change":"2024-04-17T02:22:21.262438+0000","last_active":"2024-04-17T02:22:23.245901+0000","last_peered":"2024-04-17T02:22:23.245901+0000","last_clean":"2024-04-17T02:22:23.245901+0000","last_became_active":"2024-04-17T02:22:21.261470+0000","last_became_peered":"2024-04-17T02:22:21.261470+0000","last_unstale":"2024-04-17T02:22:23.245901+0000","last_undegraded":"2024-04-17T02:22:23.245901+0000","last_fullsized":"2024-04-17T02:22:23.245901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:22:02.248276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245775+0000","last_change":"2024-04-17T02:22:22.255994+0000","last_active":"2024-04-17T02:22:23.245775+0000","last_peered":"2024-04-17T02:22:23.245775+0000","last_clean":"2024-04-17T02:22:23.245775+0000","last_became_active":"2024-04-17T02:22:22.255089+0000","last_became_peered":"2024-04-17T02:22:22.255089+0000","last_unstale":"2024-04-17T02:22:23.245775+0000","last_undegraded":"2024-04-17T02:22:23.245775+0000","last_fullsized":"2024-04-17T02:22:23.245775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:50:00.777691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248497+0000","last_change":"2024-04-17T02:22:21.259659+0000","last_active":"2024-04-17T02:22:23.248497+0000","last_peered":"2024-04-17T02:22:23.248497+0000","last_clean":"2024-04-17T02:22:23.248497+0000","last_became_active":"2024-04-17T02:22:21.259030+0000","last_became_peered":"2024-04-17T02:22:21.259030+0000","last_unstale":"2024-04-17T02:22:23.248497+0000","last_undegraded":"2024-04-17T02:22:23.248497+0000","last_fullsized":"2024-04-17T02:22:23.248497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:43:22.970177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247238+0000","last_change":"2024-04-17T02:22:22.254414+0000","last_active":"2024-04-17T02:22:23.247238+0000","last_peered":"2024-04-17T02:22:23.247238+0000","last_clean":"2024-04-17T02:22:23.247238+0000","last_became_active":"2024-04-17T02:22:22.253963+0000","last_became_peered":"2024-04-17T02:22:22.253963+0000","last_unstale":"2024-04-17T02:22:23.247238+0000","last_undegraded":"2024-04-17T02:22:23.247238+0000","last_fullsized":"2024-04-17T02:22:23.247238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:56:41.379971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247417+0000","last_change":"2024-04-17T02:22:21.266419+0000","last_active":"2024-04-17T02:22:23.247417+0000","last_peered":"2024-04-17T02:22:23.247417+0000","last_clean":"2024-04-17T02:22:23.247417+0000","last_became_active":"2024-04-17T02:22:21.266123+0000","last_became_peered":"2024-04-17T02:22:21.266123+0000","last_unstale":"2024-04-17T02:22:23.247417+0000","last_undegraded":"2024-04-17T02:22:23.247417+0000","last_fullsized":"2024-04-17T02:22:23.247417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:06:57.393992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963114+0000","last_change":"2024-04-17T02:22:22.277085+0000","last_active":"2024-04-17T02:22:23.963114+0000","last_peered":"2024-04-17T02:22:23.963114+0000","last_clean":"2024-04-17T02:22:23.963114+0000","last_became_active":"2024-04-17T02:22:22.275396+0000","last_became_peered":"2024-04-17T02:22:22.275396+0000","last_unstale":"2024-04-17T02:22:23.963114+0000","last_undegraded":"2024-04-17T02:22:23.963114+0000","last_fullsized":"2024-04-17T02:22:23.963114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:35:24.036979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":176,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962291+0000","last_change":"2024-04-17T02:22:12.100529+0000","last_active":"2024-04-17T02:22:23.962291+0000","last_peered":"2024-04-17T02:22:23.962291+0000","last_clean":"2024-04-17T02:22:23.962291+0000","last_became_active":"2024-04-17T02:22:12.100191+0000","last_became_peered":"2024-04-17T02:22:12.100191+0000","last_unstale":"2024-04-17T02:22:23.962291+0000","last_undegraded":"2024-04-17T02:22:23.962291+0000","last_fullsized":"2024-04-17T02:22:23.962291+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:11.088733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:11.088733+0000","last_clean_scrub_stamp":"2024-04-17T02:22:11.088733+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:47:32.959035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245357+0000","last_change":"2024-04-17T02:22:17.123965+0000","last_active":"2024-04-17T02:22:23.245357+0000","last_peered":"2024-04-17T02:22:23.245357+0000","last_clean":"2024-04-17T02:22:23.245357+0000","last_became_active":"2024-04-17T02:22:17.123282+0000","last_became_peered":"2024-04-17T02:22:17.123282+0000","last_unstale":"2024-04-17T02:22:23.245357+0000","last_undegraded":"2024-04-17T02:22:23.245357+0000","last_fullsized":"2024-04-17T02:22:23.245357+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:00:54.621590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247944+0000","last_change":"2024-04-17T02:22:21.259046+0000","last_active":"2024-04-17T02:22:23.247944+0000","last_peered":"2024-04-17T02:22:23.247944+0000","last_clean":"2024-04-17T02:22:23.247944+0000","last_became_active":"2024-04-17T02:22:21.258750+0000","last_became_peered":"2024-04-17T02:22:21.258750+0000","last_unstale":"2024-04-17T02:22:23.247944+0000","last_undegraded":"2024-04-17T02:22:23.247944+0000","last_fullsized":"2024-04-17T02:22:23.247944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:21:58.622774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246098+0000","last_change":"2024-04-17T02:22:22.256960+0000","last_active":"2024-04-17T02:22:23.246098+0000","last_peered":"2024-04-17T02:22:23.246098+0000","last_clean":"2024-04-17T02:22:23.246098+0000","last_became_active":"2024-04-17T02:22:22.256613+0000","last_became_peered":"2024-04-17T02:22:22.256613+0000","last_unstale":"2024-04-17T02:22:23.246098+0000","last_undegraded":"2024-04-17T02:22:23.246098+0000","last_fullsized":"2024-04-17T02:22:23.246098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:32:56.166132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.244846+0000","last_change":"2024-04-17T02:22:17.123918+0000","last_active":"2024-04-17T02:22:23.244846+0000","last_peered":"2024-04-17T02:22:23.244846+0000","last_clean":"2024-04-17T02:22:23.244846+0000","last_became_active":"2024-04-17T02:22:17.123423+0000","last_became_peered":"2024-04-17T02:22:17.123423+0000","last_unstale":"2024-04-17T02:22:23.244846+0000","last_undegraded":"2024-04-17T02:22:23.244846+0000","last_fullsized":"2024-04-17T02:22:23.244846+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:25:53.024970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962441+0000","last_change":"2024-04-17T02:22:21.260085+0000","last_active":"2024-04-17T02:22:23.962441+0000","last_peered":"2024-04-17T02:22:23.962441+0000","last_clean":"2024-04-17T02:22:23.962441+0000","last_became_active":"2024-04-17T02:22:21.259738+0000","last_became_peered":"2024-04-17T02:22:21.259738+0000","last_unstale":"2024-04-17T02:22:23.962441+0000","last_undegraded":"2024-04-17T02:22:23.962441+0000","last_fullsized":"2024-04-17T02:22:23.962441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:34:47.001187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247930+0000","last_change":"2024-04-17T02:22:22.276216+0000","last_active":"2024-04-17T02:22:23.247930+0000","last_peered":"2024-04-17T02:22:23.247930+0000","last_clean":"2024-04-17T02:22:23.247930+0000","last_became_active":"2024-04-17T02:22:22.275925+0000","last_became_peered":"2024-04-17T02:22:22.275925+0000","last_unstale":"2024-04-17T02:22:23.247930+0000","last_undegraded":"2024-04-17T02:22:23.247930+0000","last_fullsized":"2024-04-17T02:22:23.247930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:12:02.539603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247214+0000","last_change":"2024-04-17T02:22:17.560526+0000","last_active":"2024-04-17T02:22:23.247214+0000","last_peered":"2024-04-17T02:22:23.247214+0000","last_clean":"2024-04-17T02:22:23.247214+0000","last_became_active":"2024-04-17T02:22:17.560120+0000","last_became_peered":"2024-04-17T02:22:17.560120+0000","last_unstale":"2024-04-17T02:22:23.247214+0000","last_undegraded":"2024-04-17T02:22:23.247214+0000","last_fullsized":"2024-04-17T02:22:23.247214+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:49:30.975553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962096+0000","last_change":"2024-04-17T02:22:21.265155+0000","last_active":"2024-04-17T02:22:23.962096+0000","last_peered":"2024-04-17T02:22:23.962096+0000","last_clean":"2024-04-17T02:22:23.962096+0000","last_became_active":"2024-04-17T02:22:21.263791+0000","last_became_peered":"2024-04-17T02:22:21.263791+0000","last_unstale":"2024-04-17T02:22:23.962096+0000","last_undegraded":"2024-04-17T02:22:23.962096+0000","last_fullsized":"2024-04-17T02:22:23.962096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:29:08.387822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963208+0000","last_change":"2024-04-17T02:22:22.275017+0000","last_active":"2024-04-17T02:22:23.963208+0000","last_peered":"2024-04-17T02:22:23.963208+0000","last_clean":"2024-04-17T02:22:23.963208+0000","last_became_active":"2024-04-17T02:22:22.273465+0000","last_became_peered":"2024-04-17T02:22:22.273465+0000","last_unstale":"2024-04-17T02:22:23.963208+0000","last_undegraded":"2024-04-17T02:22:23.963208+0000","last_fullsized":"2024-04-17T02:22:23.963208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:44:17.761493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245862+0000","last_change":"2024-04-17T02:22:17.123761+0000","last_active":"2024-04-17T02:22:23.245862+0000","last_peered":"2024-04-17T02:22:23.245862+0000","last_clean":"2024-04-17T02:22:23.245862+0000","last_became_active":"2024-04-17T02:22:17.123264+0000","last_became_peered":"2024-04-17T02:22:17.123264+0000","last_unstale":"2024-04-17T02:22:23.245862+0000","last_undegraded":"2024-04-17T02:22:23.245862+0000","last_fullsized":"2024-04-17T02:22:23.245862+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:51:28.918451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245315+0000","last_change":"2024-04-17T02:22:21.262295+0000","last_active":"2024-04-17T02:22:23.245315+0000","last_peered":"2024-04-17T02:22:23.245315+0000","last_clean":"2024-04-17T02:22:23.245315+0000","last_became_active":"2024-04-17T02:22:21.261890+0000","last_became_peered":"2024-04-17T02:22:21.261890+0000","last_unstale":"2024-04-17T02:22:23.245315+0000","last_undegraded":"2024-04-17T02:22:23.245315+0000","last_fullsized":"2024-04-17T02:22:23.245315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:31:33.861752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963136+0000","last_change":"2024-04-17T02:22:22.275199+0000","last_active":"2024-04-17T02:22:23.963136+0000","last_peered":"2024-04-17T02:22:23.963136+0000","last_clean":"2024-04-17T02:22:23.963136+0000","last_became_active":"2024-04-17T02:22:22.274892+0000","last_became_peered":"2024-04-17T02:22:22.274892+0000","last_unstale":"2024-04-17T02:22:23.963136+0000","last_undegraded":"2024-04-17T02:22:23.963136+0000","last_fullsized":"2024-04-17T02:22:23.963136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:58:55.176237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246122+0000","last_change":"2024-04-17T02:22:21.256839+0000","last_active":"2024-04-17T02:22:23.246122+0000","last_peered":"2024-04-17T02:22:23.246122+0000","last_clean":"2024-04-17T02:22:23.246122+0000","last_became_active":"2024-04-17T02:22:21.255764+0000","last_became_peered":"2024-04-17T02:22:21.255764+0000","last_unstale":"2024-04-17T02:22:23.246122+0000","last_undegraded":"2024-04-17T02:22:23.246122+0000","last_fullsized":"2024-04-17T02:22:23.246122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:05:15.621470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963324+0000","last_change":"2024-04-17T02:22:17.560478+0000","last_active":"2024-04-17T02:22:23.963324+0000","last_peered":"2024-04-17T02:22:23.963324+0000","last_clean":"2024-04-17T02:22:23.963324+0000","last_became_active":"2024-04-17T02:22:17.560133+0000","last_became_peered":"2024-04-17T02:22:17.560133+0000","last_unstale":"2024-04-17T02:22:23.963324+0000","last_undegraded":"2024-04-17T02:22:23.963324+0000","last_fullsized":"2024-04-17T02:22:23.963324+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:36:01.410663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962278+0000","last_change":"2024-04-17T02:22:22.277210+0000","last_active":"2024-04-17T02:22:23.962278+0000","last_peered":"2024-04-17T02:22:23.962278+0000","last_clean":"2024-04-17T02:22:23.962278+0000","last_became_active":"2024-04-17T02:22:22.275055+0000","last_became_peered":"2024-04-17T02:22:22.275055+0000","last_unstale":"2024-04-17T02:22:23.962278+0000","last_undegraded":"2024-04-17T02:22:23.962278+0000","last_fullsized":"2024-04-17T02:22:23.962278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:59:56.366536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963255+0000","last_change":"2024-04-17T02:22:21.259328+0000","last_active":"2024-04-17T02:22:23.963255+0000","last_peered":"2024-04-17T02:22:23.963255+0000","last_clean":"2024-04-17T02:22:23.963255+0000","last_became_active":"2024-04-17T02:22:21.259133+0000","last_became_peered":"2024-04-17T02:22:21.259133+0000","last_unstale":"2024-04-17T02:22:23.963255+0000","last_undegraded":"2024-04-17T02:22:23.963255+0000","last_fullsized":"2024-04-17T02:22:23.963255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:36:10.793622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246164+0000","last_change":"2024-04-17T02:22:17.124496+0000","last_active":"2024-04-17T02:22:23.246164+0000","last_peered":"2024-04-17T02:22:23.246164+0000","last_clean":"2024-04-17T02:22:23.246164+0000","last_became_active":"2024-04-17T02:22:17.123440+0000","last_became_peered":"2024-04-17T02:22:17.123440+0000","last_unstale":"2024-04-17T02:22:23.246164+0000","last_undegraded":"2024-04-17T02:22:23.246164+0000","last_fullsized":"2024-04-17T02:22:23.246164+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:29:11.971454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962511+0000","last_change":"2024-04-17T02:22:22.268601+0000","last_active":"2024-04-17T02:22:23.962511+0000","last_peered":"2024-04-17T02:22:23.962511+0000","last_clean":"2024-04-17T02:22:23.962511+0000","last_became_active":"2024-04-17T02:22:22.267752+0000","last_became_peered":"2024-04-17T02:22:22.267752+0000","last_unstale":"2024-04-17T02:22:23.962511+0000","last_undegraded":"2024-04-17T02:22:23.962511+0000","last_fullsized":"2024-04-17T02:22:23.962511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:24:39.123134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248403+0000","last_change":"2024-04-17T02:22:21.265332+0000","last_active":"2024-04-17T02:22:23.248403+0000","last_peered":"2024-04-17T02:22:23.248403+0000","last_clean":"2024-04-17T02:22:23.248403+0000","last_became_active":"2024-04-17T02:22:21.265029+0000","last_became_peered":"2024-04-17T02:22:21.265029+0000","last_unstale":"2024-04-17T02:22:23.248403+0000","last_undegraded":"2024-04-17T02:22:23.248403+0000","last_fullsized":"2024-04-17T02:22:23.248403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:34:47.001187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963263+0000","last_change":"2024-04-17T02:22:17.121783+0000","last_active":"2024-04-17T02:22:23.963263+0000","last_peered":"2024-04-17T02:22:23.963263+0000","last_clean":"2024-04-17T02:22:23.963263+0000","last_became_active":"2024-04-17T02:22:17.121502+0000","last_became_peered":"2024-04-17T02:22:17.121502+0000","last_unstale":"2024-04-17T02:22:23.963263+0000","last_undegraded":"2024-04-17T02:22:23.963263+0000","last_fullsized":"2024-04-17T02:22:23.963263+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:05:41.795170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247296+0000","last_change":"2024-04-17T02:22:22.279268+0000","last_active":"2024-04-17T02:22:23.247296+0000","last_peered":"2024-04-17T02:22:23.247296+0000","last_clean":"2024-04-17T02:22:23.247296+0000","last_became_active":"2024-04-17T02:22:22.278986+0000","last_became_peered":"2024-04-17T02:22:22.278986+0000","last_unstale":"2024-04-17T02:22:23.247296+0000","last_undegraded":"2024-04-17T02:22:23.247296+0000","last_fullsized":"2024-04-17T02:22:23.247296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:27:10.507427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:24.246277+0000","last_change":"2024-04-17T02:22:21.261825+0000","last_active":"2024-04-17T02:22:24.246277+0000","last_peered":"2024-04-17T02:22:24.246277+0000","last_clean":"2024-04-17T02:22:24.246277+0000","last_became_active":"2024-04-17T02:22:21.261319+0000","last_became_peered":"2024-04-17T02:22:21.261319+0000","last_unstale":"2024-04-17T02:22:24.246277+0000","last_undegraded":"2024-04-17T02:22:24.246277+0000","last_fullsized":"2024-04-17T02:22:24.246277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:43:22.970177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245937+0000","last_change":"2024-04-17T02:22:17.123744+0000","last_active":"2024-04-17T02:22:23.245937+0000","last_peered":"2024-04-17T02:22:23.245937+0000","last_clean":"2024-04-17T02:22:23.245937+0000","last_became_active":"2024-04-17T02:22:17.123322+0000","last_became_peered":"2024-04-17T02:22:17.123322+0000","last_unstale":"2024-04-17T02:22:23.245937+0000","last_undegraded":"2024-04-17T02:22:23.245937+0000","last_fullsized":"2024-04-17T02:22:23.245937+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:36:41.743830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246504+0000","last_change":"2024-04-17T02:22:22.249162+0000","last_active":"2024-04-17T02:22:23.246504+0000","last_peered":"2024-04-17T02:22:23.246504+0000","last_clean":"2024-04-17T02:22:23.246504+0000","last_became_active":"2024-04-17T02:22:22.248758+0000","last_became_peered":"2024-04-17T02:22:22.248758+0000","last_unstale":"2024-04-17T02:22:23.246504+0000","last_undegraded":"2024-04-17T02:22:23.246504+0000","last_fullsized":"2024-04-17T02:22:23.246504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:18:48.496574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247007+0000","last_change":"2024-04-17T02:22:22.254193+0000","last_active":"2024-04-17T02:22:23.247007+0000","last_peered":"2024-04-17T02:22:23.247007+0000","last_clean":"2024-04-17T02:22:23.247007+0000","last_became_active":"2024-04-17T02:22:22.253786+0000","last_became_peered":"2024-04-17T02:22:22.253786+0000","last_unstale":"2024-04-17T02:22:23.247007+0000","last_undegraded":"2024-04-17T02:22:23.247007+0000","last_fullsized":"2024-04-17T02:22:23.247007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:35:40.664294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245532+0000","last_change":"2024-04-17T02:22:21.248985+0000","last_active":"2024-04-17T02:22:23.245532+0000","last_peered":"2024-04-17T02:22:23.245532+0000","last_clean":"2024-04-17T02:22:23.245532+0000","last_became_active":"2024-04-17T02:22:21.248664+0000","last_became_peered":"2024-04-17T02:22:21.248664+0000","last_unstale":"2024-04-17T02:22:23.245532+0000","last_undegraded":"2024-04-17T02:22:23.245532+0000","last_fullsized":"2024-04-17T02:22:23.245532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:35:39.662298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962584+0000","last_change":"2024-04-17T02:22:22.273634+0000","last_active":"2024-04-17T02:22:23.962584+0000","last_peered":"2024-04-17T02:22:23.962584+0000","last_clean":"2024-04-17T02:22:23.962584+0000","last_became_active":"2024-04-17T02:22:22.273338+0000","last_became_peered":"2024-04-17T02:22:22.273338+0000","last_unstale":"2024-04-17T02:22:23.962584+0000","last_undegraded":"2024-04-17T02:22:23.962584+0000","last_fullsized":"2024-04-17T02:22:23.962584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:06:11.399207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247114+0000","last_change":"2024-04-17T02:22:21.253661+0000","last_active":"2024-04-17T02:22:23.247114+0000","last_peered":"2024-04-17T02:22:23.247114+0000","last_clean":"2024-04-17T02:22:23.247114+0000","last_became_active":"2024-04-17T02:22:21.253375+0000","last_became_peered":"2024-04-17T02:22:21.253375+0000","last_unstale":"2024-04-17T02:22:23.247114+0000","last_undegraded":"2024-04-17T02:22:23.247114+0000","last_fullsized":"2024-04-17T02:22:23.247114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:36:45.870213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245991+0000","last_change":"2024-04-17T02:22:21.261955+0000","last_active":"2024-04-17T02:22:23.245991+0000","last_peered":"2024-04-17T02:22:23.245991+0000","last_clean":"2024-04-17T02:22:23.245991+0000","last_became_active":"2024-04-17T02:22:21.261671+0000","last_became_peered":"2024-04-17T02:22:21.261671+0000","last_unstale":"2024-04-17T02:22:23.245991+0000","last_undegraded":"2024-04-17T02:22:23.245991+0000","last_fullsized":"2024-04-17T02:22:23.245991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:58:48.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248551+0000","last_change":"2024-04-17T02:22:22.259450+0000","last_active":"2024-04-17T02:22:23.248551+0000","last_peered":"2024-04-17T02:22:23.248551+0000","last_clean":"2024-04-17T02:22:23.248551+0000","last_became_active":"2024-04-17T02:22:22.259173+0000","last_became_peered":"2024-04-17T02:22:22.259173+0000","last_unstale":"2024-04-17T02:22:23.248551+0000","last_undegraded":"2024-04-17T02:22:23.248551+0000","last_fullsized":"2024-04-17T02:22:23.248551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:33:01.850142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963409+0000","last_change":"2024-04-17T02:22:21.261243+0000","last_active":"2024-04-17T02:22:23.963409+0000","last_peered":"2024-04-17T02:22:23.963409+0000","last_clean":"2024-04-17T02:22:23.963409+0000","last_became_active":"2024-04-17T02:22:21.260251+0000","last_became_peered":"2024-04-17T02:22:21.260251+0000","last_unstale":"2024-04-17T02:22:23.963409+0000","last_undegraded":"2024-04-17T02:22:23.963409+0000","last_fullsized":"2024-04-17T02:22:23.963409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:04:55.664715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247132+0000","last_change":"2024-04-17T02:22:22.279329+0000","last_active":"2024-04-17T02:22:23.247132+0000","last_peered":"2024-04-17T02:22:23.247132+0000","last_clean":"2024-04-17T02:22:23.247132+0000","last_became_active":"2024-04-17T02:22:22.278952+0000","last_became_peered":"2024-04-17T02:22:22.278952+0000","last_unstale":"2024-04-17T02:22:23.247132+0000","last_undegraded":"2024-04-17T02:22:23.247132+0000","last_fullsized":"2024-04-17T02:22:23.247132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:05:16.623466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245889+0000","last_change":"2024-04-17T02:22:22.259026+0000","last_active":"2024-04-17T02:22:23.245889+0000","last_peered":"2024-04-17T02:22:23.245889+0000","last_clean":"2024-04-17T02:22:23.245889+0000","last_became_active":"2024-04-17T02:22:22.258727+0000","last_became_peered":"2024-04-17T02:22:22.258727+0000","last_unstale":"2024-04-17T02:22:23.245889+0000","last_undegraded":"2024-04-17T02:22:23.245889+0000","last_fullsized":"2024-04-17T02:22:23.245889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:49:55.581353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247317+0000","last_change":"2024-04-17T02:22:21.266400+0000","last_active":"2024-04-17T02:22:23.247317+0000","last_peered":"2024-04-17T02:22:23.247317+0000","last_clean":"2024-04-17T02:22:23.247317+0000","last_became_active":"2024-04-17T02:22:21.266106+0000","last_became_peered":"2024-04-17T02:22:21.266106+0000","last_unstale":"2024-04-17T02:22:23.247317+0000","last_undegraded":"2024-04-17T02:22:23.247317+0000","last_fullsized":"2024-04-17T02:22:23.247317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:17:38.056686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963025+0000","last_change":"2024-04-17T02:22:22.275393+0000","last_active":"2024-04-17T02:22:23.963025+0000","last_peered":"2024-04-17T02:22:23.963025+0000","last_clean":"2024-04-17T02:22:23.963025+0000","last_became_active":"2024-04-17T02:22:22.273656+0000","last_became_peered":"2024-04-17T02:22:22.273656+0000","last_unstale":"2024-04-17T02:22:23.963025+0000","last_undegraded":"2024-04-17T02:22:23.963025+0000","last_fullsized":"2024-04-17T02:22:23.963025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:09:57.616528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962374+0000","last_change":"2024-04-17T02:22:21.263049+0000","last_active":"2024-04-17T02:22:23.962374+0000","last_peered":"2024-04-17T02:22:23.962374+0000","last_clean":"2024-04-17T02:22:23.962374+0000","last_became_active":"2024-04-17T02:22:21.262318+0000","last_became_peered":"2024-04-17T02:22:21.262318+0000","last_unstale":"2024-04-17T02:22:23.962374+0000","last_undegraded":"2024-04-17T02:22:23.962374+0000","last_fullsized":"2024-04-17T02:22:23.962374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:06:57.393992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247996+0000","last_change":"2024-04-17T02:22:22.269974+0000","last_active":"2024-04-17T02:22:23.247996+0000","last_peered":"2024-04-17T02:22:23.247996+0000","last_clean":"2024-04-17T02:22:23.247996+0000","last_became_active":"2024-04-17T02:22:22.269670+0000","last_became_peered":"2024-04-17T02:22:22.269670+0000","last_unstale":"2024-04-17T02:22:23.247996+0000","last_undegraded":"2024-04-17T02:22:23.247996+0000","last_fullsized":"2024-04-17T02:22:23.247996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:40:01.962151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245667+0000","last_change":"2024-04-17T02:22:21.264230+0000","last_active":"2024-04-17T02:22:23.245667+0000","last_peered":"2024-04-17T02:22:23.245667+0000","last_clean":"2024-04-17T02:22:23.245667+0000","last_became_active":"2024-04-17T02:22:21.263922+0000","last_became_peered":"2024-04-17T02:22:21.263922+0000","last_unstale":"2024-04-17T02:22:23.245667+0000","last_undegraded":"2024-04-17T02:22:23.245667+0000","last_fullsized":"2024-04-17T02:22:23.245667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:42:08.530787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246821+0000","last_change":"2024-04-17T02:22:22.272294+0000","last_active":"2024-04-17T02:22:23.246821+0000","last_peered":"2024-04-17T02:22:23.246821+0000","last_clean":"2024-04-17T02:22:23.246821+0000","last_became_active":"2024-04-17T02:22:22.272022+0000","last_became_peered":"2024-04-17T02:22:22.272022+0000","last_unstale":"2024-04-17T02:22:23.246821+0000","last_undegraded":"2024-04-17T02:22:23.246821+0000","last_fullsized":"2024-04-17T02:22:23.246821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:04:01.559523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248286+0000","last_change":"2024-04-17T02:22:21.260781+0000","last_active":"2024-04-17T02:22:23.248286+0000","last_peered":"2024-04-17T02:22:23.248286+0000","last_clean":"2024-04-17T02:22:23.248286+0000","last_became_active":"2024-04-17T02:22:21.260216+0000","last_became_peered":"2024-04-17T02:22:21.260216+0000","last_unstale":"2024-04-17T02:22:23.248286+0000","last_undegraded":"2024-04-17T02:22:23.248286+0000","last_fullsized":"2024-04-17T02:22:23.248286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:25:57.151354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246613+0000","last_change":"2024-04-17T02:22:22.260715+0000","last_active":"2024-04-17T02:22:23.246613+0000","last_peered":"2024-04-17T02:22:23.246613+0000","last_clean":"2024-04-17T02:22:23.246613+0000","last_became_active":"2024-04-17T02:22:22.260292+0000","last_became_peered":"2024-04-17T02:22:22.260292+0000","last_unstale":"2024-04-17T02:22:23.246613+0000","last_undegraded":"2024-04-17T02:22:23.246613+0000","last_fullsized":"2024-04-17T02:22:23.246613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:04:56.666711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963098+0000","last_change":"2024-04-17T02:22:21.263024+0000","last_active":"2024-04-17T02:22:23.963098+0000","last_peered":"2024-04-17T02:22:23.963098+0000","last_clean":"2024-04-17T02:22:23.963098+0000","last_became_active":"2024-04-17T02:22:21.262335+0000","last_became_peered":"2024-04-17T02:22:21.262335+0000","last_unstale":"2024-04-17T02:22:23.963098+0000","last_undegraded":"2024-04-17T02:22:23.963098+0000","last_fullsized":"2024-04-17T02:22:23.963098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:21:11.268956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245289+0000","last_change":"2024-04-17T02:22:22.251488+0000","last_active":"2024-04-17T02:22:23.245289+0000","last_peered":"2024-04-17T02:22:23.245289+0000","last_clean":"2024-04-17T02:22:23.245289+0000","last_became_active":"2024-04-17T02:22:22.251111+0000","last_became_peered":"2024-04-17T02:22:22.251111+0000","last_unstale":"2024-04-17T02:22:23.245289+0000","last_undegraded":"2024-04-17T02:22:23.245289+0000","last_fullsized":"2024-04-17T02:22:23.245289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:43:59.776760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245935+0000","last_change":"2024-04-17T02:22:21.257583+0000","last_active":"2024-04-17T02:22:23.245935+0000","last_peered":"2024-04-17T02:22:23.245935+0000","last_clean":"2024-04-17T02:22:23.245935+0000","last_became_active":"2024-04-17T02:22:21.257330+0000","last_became_peered":"2024-04-17T02:22:21.257330+0000","last_unstale":"2024-04-17T02:22:23.245935+0000","last_undegraded":"2024-04-17T02:22:23.245935+0000","last_fullsized":"2024-04-17T02:22:23.245935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:26:37.106505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248640+0000","last_change":"2024-04-17T02:22:22.264602+0000","last_active":"2024-04-17T02:22:23.248640+0000","last_peered":"2024-04-17T02:22:23.248640+0000","last_clean":"2024-04-17T02:22:23.248640+0000","last_became_active":"2024-04-17T02:22:22.264319+0000","last_became_peered":"2024-04-17T02:22:22.264319+0000","last_unstale":"2024-04-17T02:22:23.248640+0000","last_undegraded":"2024-04-17T02:22:23.248640+0000","last_fullsized":"2024-04-17T02:22:23.248640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:45:35.746928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248295+0000","last_change":"2024-04-17T02:22:21.259254+0000","last_active":"2024-04-17T02:22:23.248295+0000","last_peered":"2024-04-17T02:22:23.248295+0000","last_clean":"2024-04-17T02:22:23.248295+0000","last_became_active":"2024-04-17T02:22:21.258944+0000","last_became_peered":"2024-04-17T02:22:21.258944+0000","last_unstale":"2024-04-17T02:22:23.248295+0000","last_undegraded":"2024-04-17T02:22:23.248295+0000","last_fullsized":"2024-04-17T02:22:23.248295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:21:11.268956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245623+0000","last_change":"2024-04-17T02:22:22.276249+0000","last_active":"2024-04-17T02:22:23.245623+0000","last_peered":"2024-04-17T02:22:23.245623+0000","last_clean":"2024-04-17T02:22:23.245623+0000","last_became_active":"2024-04-17T02:22:22.275817+0000","last_became_peered":"2024-04-17T02:22:22.275817+0000","last_unstale":"2024-04-17T02:22:23.245623+0000","last_undegraded":"2024-04-17T02:22:23.245623+0000","last_fullsized":"2024-04-17T02:22:23.245623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:44:37.302631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963340+0000","last_change":"2024-04-17T02:22:21.260966+0000","last_active":"2024-04-17T02:22:23.963340+0000","last_peered":"2024-04-17T02:22:23.963340+0000","last_clean":"2024-04-17T02:22:23.963340+0000","last_became_active":"2024-04-17T02:22:21.260540+0000","last_became_peered":"2024-04-17T02:22:21.260540+0000","last_unstale":"2024-04-17T02:22:23.963340+0000","last_undegraded":"2024-04-17T02:22:23.963340+0000","last_fullsized":"2024-04-17T02:22:23.963340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:18:47.494578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65024,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705672,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":63778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":656236,"data_compressed":32512,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705672,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":654556,"data_compressed":32512,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705672,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":208896,"data_stored":65322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32512,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32512,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T02:22:34.812 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T02:22:34.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.948+0000 7fb2d20d3640 1 Processor -- start 2024-04-17T02:22:34.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.948+0000 7fb2d20d3640 1 -- start start 2024-04-17T02:22:34.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.948+0000 7fb2d20d3640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb2cc13b540 0x7fb2cc148f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:34.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.948+0000 7fb2d20d3640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb2cc0a9c00 0x7fb2cc0aa090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:34.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.948+0000 7fb2d20d3640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2cc148870 con 0x7fb2cc0b8e30 2024-04-17T02:22:34.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.948+0000 7fb2d20d3640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fb2cc0b9210 con 0x7fb2cc13b540 2024-04-17T02:22:34.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.948+0000 7fb2d20d3640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fb2cc13bc90 con 0x7fb2cc0a9c00 2024-04-17T02:22:34.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.949+0000 7fb2cbfff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb2cc0a9c00 0x7fb2cc0aa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:34.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.949+0000 7fb2cb7fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fb2cc0b8e30 0x7fb2cc0aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42058/0 (socket says 172.21.15.17:42058) 2024-04-17T02:22:34.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.949+0000 7fb2cbfff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb2cc0a9c00 0x7fb2cc0aa090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:53162/0 (socket says 172.21.15.17:53162) 2024-04-17T02:22:34.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.949+0000 7fb2cb7fe640 1 -- 172.21.15.17:0/2124199482 learned_addr learned my addr 172.21.15.17:0/2124199482 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:22:34.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.949+0000 7fb2c3fff640 1 --2- 172.21.15.17:0/2124199482 >> v2:172.21.15.122:3300/0 conn(0x7fb2cc13b540 0x7fb2cc148f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:34.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.949+0000 7fb2cbfff640 1 -- 172.21.15.17:0/2124199482 >> v2:172.21.15.122:3300/0 conn(0x7fb2cc13b540 msgr2=0x7fb2cc148f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:34.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.949+0000 7fb2cbfff640 1 --2- 172.21.15.17:0/2124199482 >> v2:172.21.15.122:3300/0 conn(0x7fb2cc13b540 0x7fb2cc148f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.949+0000 7fb2cbfff640 1 -- 172.21.15.17:0/2124199482 >> v1:172.21.15.17:6789/0 conn(0x7fb2cc0b8e30 legacy=0x7fb2cc0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:34.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.949+0000 7fb2caffd640 1 -- 172.21.15.17:0/2124199482 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1927016202 0 0) 0x7fb2cc148870 con 0x7fb2cc0b8e30 2024-04-17T02:22:34.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.949+0000 7fb2cbfff640 1 -- 172.21.15.17:0/2124199482 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2cc149490 con 0x7fb2cc0a9c00 2024-04-17T02:22:34.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.949+0000 7fb2c3fff640 1 --2- 172.21.15.17:0/2124199482 >> v2:172.21.15.122:3300/0 conn(0x7fb2cc13b540 0x7fb2cc148f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T02:22:34.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.950+0000 7fb2cbfff640 1 --2- 172.21.15.17:0/2124199482 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb2cc0a9c00 0x7fb2cc0aa090 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb2c4009d90 tx=0x7fb2c402be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45d53403493fe018 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:34.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.950+0000 7fb2caffd640 1 -- 172.21.15.17:0/2124199482 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c4039070 con 0x7fb2cc0a9c00 2024-04-17T02:22:34.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.950+0000 7fb2caffd640 1 -- 172.21.15.17:0/2124199482 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2c402cbc0 con 0x7fb2cc0a9c00 2024-04-17T02:22:34.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.950+0000 7fb2caffd640 1 -- 172.21.15.17:0/2124199482 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c4034440 con 0x7fb2cc0a9c00 2024-04-17T02:22:34.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.950+0000 7fb2d20d3640 1 -- 172.21.15.17:0/2124199482 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb2cc0a9c00 msgr2=0x7fb2cc0aa090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:34.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.950+0000 7fb2d20d3640 1 --2- 172.21.15.17:0/2124199482 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb2cc0a9c00 0x7fb2cc0aa090 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb2c4009d90 tx=0x7fb2c402be10 comp rx=0 tx=0).stop 2024-04-17T02:22:34.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.950+0000 7fb2d20d3640 1 -- 172.21.15.17:0/2124199482 shutdown_connections 2024-04-17T02:22:34.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.950+0000 7fb2d20d3640 1 --2- 172.21.15.17:0/2124199482 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb2cc0a9c00 0x7fb2cc0aa090 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.950+0000 7fb2d20d3640 1 --2- 172.21.15.17:0/2124199482 >> v2:172.21.15.122:3300/0 conn(0x7fb2cc13b540 0x7fb2cc148f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.950+0000 7fb2d20d3640 1 -- 172.21.15.17:0/2124199482 >> 172.21.15.17:0/2124199482 conn(0x7fb2cc0741a0 msgr2=0x7fb2cc0745b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:34.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.950+0000 7fb2d20d3640 1 -- 172.21.15.17:0/2124199482 shutdown_connections 2024-04-17T02:22:34.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.950+0000 7fb2d20d3640 1 -- 172.21.15.17:0/2124199482 wait complete. 2024-04-17T02:22:34.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.951+0000 7fb2d20d3640 1 Processor -- start 2024-04-17T02:22:34.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.952+0000 7fb2d20d3640 1 -- start start 2024-04-17T02:22:34.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.952+0000 7fb2d20d3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2cc0a9c00 0x7fb2cc14c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:34.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.952+0000 7fb2d20d3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2cc0b8e30 0x7fb2cc06dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:34.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.952+0000 7fb2d20d3640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb2cc13b540 0x7fb2cc06e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:34.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.952+0000 7fb2d20d3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb2cc14fdb0 con 0x7fb2cc0b8e30 2024-04-17T02:22:34.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.952+0000 7fb2d20d3640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb2cc14fc30 con 0x7fb2cc0a9c00 2024-04-17T02:22:34.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.952+0000 7fb2d20d3640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fb2cc14ff30 con 0x7fb2cc13b540 2024-04-17T02:22:34.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.952+0000 7fb2c3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2cc0b8e30 0x7fb2cc06dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:34.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.952+0000 7fb2cbfff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb2cc13b540 0x7fb2cc06e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:34.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.952+0000 7fb2c3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2cc0b8e30 0x7fb2cc06dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52570/0 (socket says 172.21.15.17:52570) 2024-04-17T02:22:34.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.952+0000 7fb2c3fff640 1 -- 172.21.15.17:0/3538019092 learned_addr learned my addr 172.21.15.17:0/3538019092 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:34.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.952+0000 7fb2cbfff640 1 --2- 172.21.15.17:0/3538019092 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb2cc13b540 0x7fb2cc06e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:53166/0 (socket says 172.21.15.17:53166) 2024-04-17T02:22:34.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.952+0000 7fb2cb7fe640 1 --2- 172.21.15.17:0/3538019092 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2cc0a9c00 0x7fb2cc14c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:34.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.952+0000 7fb2cbfff640 1 -- 172.21.15.17:0/3538019092 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2cc0a9c00 msgr2=0x7fb2cc14c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:34.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.952+0000 7fb2cbfff640 1 --2- 172.21.15.17:0/3538019092 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2cc0a9c00 0x7fb2cc14c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.952+0000 7fb2cbfff640 1 -- 172.21.15.17:0/3538019092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2cc0b8e30 msgr2=0x7fb2cc06dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:34.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.952+0000 7fb2cbfff640 1 --2- 172.21.15.17:0/3538019092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2cc0b8e30 0x7fb2cc06dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:34.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.952+0000 7fb2cbfff640 1 -- 172.21.15.17:0/3538019092 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2cc06ea10 con 0x7fb2cc13b540 2024-04-17T02:22:34.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.952+0000 7fb2c3fff640 1 --2- 172.21.15.17:0/3538019092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2cc0b8e30 0x7fb2cc06dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:34.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.952+0000 7fb2cb7fe640 1 --2- 172.21.15.17:0/3538019092 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2cc0a9c00 0x7fb2cc14c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T02:22:34.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.953+0000 7fb2cbfff640 1 --2- 172.21.15.17:0/3538019092 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb2cc13b540 0x7fb2cc06e2c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc072e00 tx=0x7fb2c4004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:34.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.953+0000 7fb2c8ff9640 1 -- 172.21.15.17:0/3538019092 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c4039050 con 0x7fb2cc13b540 2024-04-17T02:22:34.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.953+0000 7fb2c8ff9640 1 -- 172.21.15.17:0/3538019092 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2c4045070 con 0x7fb2cc13b540 2024-04-17T02:22:34.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.953+0000 7fb2d20d3640 1 -- 172.21.15.17:0/3538019092 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2cc06ecd0 con 0x7fb2cc13b540 2024-04-17T02:22:34.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.953+0000 7fb2c8ff9640 1 -- 172.21.15.17:0/3538019092 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c403e850 con 0x7fb2cc13b540 2024-04-17T02:22:34.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.953+0000 7fb2d20d3640 1 -- 172.21.15.17:0/3538019092 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2cc145fc0 con 0x7fb2cc13b540 2024-04-17T02:22:34.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.954+0000 7fb2d20d3640 1 -- 172.21.15.17:0/3538019092 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2cc0a8740 con 0x7fb2cc13b540 2024-04-17T02:22:34.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.955+0000 7fb2c8ff9640 1 -- 172.21.15.17:0/3538019092 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7fb2c403e9f0 con 0x7fb2cc13b540 2024-04-17T02:22:34.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.955+0000 7fb2c8ff9640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:34.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.955+0000 7fb2c8ff9640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:34.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.955+0000 7fb2c8ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:34.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.955+0000 7fb2c8ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:34.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.955+0000 7fb2c8ff9640 1 --2- 172.21.15.17:0/3538019092 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fb2ac09f480 0x7fb2ac0a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:34.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.956+0000 7fb2cb7fe640 1 --2- 172.21.15.17:0/3538019092 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fb2ac09f480 0x7fb2ac0a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:34.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.956+0000 7fb2c8ff9640 1 -- 172.21.15.17:0/3538019092 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7fb2c40ec4f0 con 0x7fb2cc13b540 2024-04-17T02:22:34.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.956+0000 7fb2cb7fe640 1 --2- 172.21.15.17:0/3538019092 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fb2ac09f480 0x7fb2ac0a1940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc000f60 tx=0x7fb2bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:34.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:34.960+0000 7fb2c8ff9640 1 -- 172.21.15.17:0/3538019092 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb2c40bb670 con 0x7fb2cc13b540 2024-04-17T02:22:35.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.136+0000 7fb2d20d3640 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2024-04-17T02:22:35.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.136+0000 7fb2d20d3640 1 -- 172.21.15.17:0/3538019092 --> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb2cc0687f0 con 0x7fb2ac09f480 2024-04-17T02:22:35.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.142+0000 7fb2c8ff9640 1 -- 172.21.15.17:0/3538019092 <== mgr.4103 v2:172.21.15.17:6808/563692809 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+268617 (secure 0 0 0) 0x7fb2cc0687f0 con 0x7fb2ac09f480 2024-04-17T02:22:35.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.142+0000 7fb2c8ff9640 20 mgrc handle_command_reply tid 0 r 0 2024-04-17T02:22:35.147 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:22:35.149 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-04-17T02:22:35.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.145+0000 7fb2d20d3640 10 mgrc shutdown 2024-04-17T02:22:35.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.145+0000 7fb2d20d3640 1 -- 172.21.15.17:0/3538019092 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fb2ac09f480 msgr2=0x7fb2ac0a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:35.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.145+0000 7fb2d20d3640 1 --2- 172.21.15.17:0/3538019092 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fb2ac09f480 0x7fb2ac0a1940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc000f60 tx=0x7fb2bc009040 comp rx=0 tx=0).stop 2024-04-17T02:22:35.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.145+0000 7fb2d20d3640 1 -- 172.21.15.17:0/3538019092 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb2cc13b540 msgr2=0x7fb2cc06e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:35.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.145+0000 7fb2d20d3640 1 --2- 172.21.15.17:0/3538019092 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb2cc13b540 0x7fb2cc06e2c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc072e00 tx=0x7fb2c4004a40 comp rx=0 tx=0).stop 2024-04-17T02:22:35.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.145+0000 7fb2d20d3640 1 -- 172.21.15.17:0/3538019092 shutdown_connections 2024-04-17T02:22:35.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.145+0000 7fb2d20d3640 1 --2- 172.21.15.17:0/3538019092 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fb2ac09f480 0x7fb2ac0a1940 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:35.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.145+0000 7fb2d20d3640 1 --2- 172.21.15.17:0/3538019092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2cc0b8e30 0x7fb2cc06dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:35.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.145+0000 7fb2d20d3640 1 --2- 172.21.15.17:0/3538019092 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb2cc13b540 0x7fb2cc06e2c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:35.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.145+0000 7fb2d20d3640 1 --2- 172.21.15.17:0/3538019092 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2cc0a9c00 0x7fb2cc14c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:35.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.145+0000 7fb2d20d3640 1 -- 172.21.15.17:0/3538019092 >> 172.21.15.17:0/3538019092 conn(0x7fb2cc0741a0 msgr2=0x7fb2cc072220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:35.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.145+0000 7fb2d20d3640 1 -- 172.21.15.17:0/3538019092 shutdown_connections 2024-04-17T02:22:35.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.145+0000 7fb2d20d3640 1 -- 172.21.15.17:0/3538019092 wait complete. 2024-04-17T02:22:35.157 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-04-17T02:22:34.506846+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":113176,"kb_used_data":912,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377374184,"statfs":{"total":386547056640,"available":386431164416,"internally_reserved":0,"allocated":933888,"data_stored":1439892,"data_compressed":65024,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":6377,"internal_metadata":114878231},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.263851"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247513+0000","last_change":"2024-04-17T02:22:22.259104+0000","last_active":"2024-04-17T02:22:23.247513+0000","last_peered":"2024-04-17T02:22:23.247513+0000","last_clean":"2024-04-17T02:22:23.247513+0000","last_became_active":"2024-04-17T02:22:22.258830+0000","last_became_peered":"2024-04-17T02:22:22.258830+0000","last_unstale":"2024-04-17T02:22:23.247513+0000","last_undegraded":"2024-04-17T02:22:23.247513+0000","last_fullsized":"2024-04-17T02:22:23.247513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:42:09.532783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245851+0000","last_change":"2024-04-17T02:22:22.274708+0000","last_active":"2024-04-17T02:22:23.245851+0000","last_peered":"2024-04-17T02:22:23.245851+0000","last_clean":"2024-04-17T02:22:23.245851+0000","last_became_active":"2024-04-17T02:22:22.274397+0000","last_became_peered":"2024-04-17T02:22:22.274397+0000","last_unstale":"2024-04-17T02:22:23.245851+0000","last_undegraded":"2024-04-17T02:22:23.245851+0000","last_fullsized":"2024-04-17T02:22:23.245851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:04:31.488847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245739+0000","last_change":"2024-04-17T02:22:22.257081+0000","last_active":"2024-04-17T02:22:23.245739+0000","last_peered":"2024-04-17T02:22:23.245739+0000","last_clean":"2024-04-17T02:22:23.245739+0000","last_became_active":"2024-04-17T02:22:22.256695+0000","last_became_peered":"2024-04-17T02:22:22.256695+0000","last_unstale":"2024-04-17T02:22:23.245739+0000","last_undegraded":"2024-04-17T02:22:23.245739+0000","last_fullsized":"2024-04-17T02:22:23.245739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:52:02.173760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962692+0000","last_change":"2024-04-17T02:22:22.272106+0000","last_active":"2024-04-17T02:22:23.962692+0000","last_peered":"2024-04-17T02:22:23.962692+0000","last_clean":"2024-04-17T02:22:23.962692+0000","last_became_active":"2024-04-17T02:22:22.271074+0000","last_became_peered":"2024-04-17T02:22:22.271074+0000","last_unstale":"2024-04-17T02:22:23.962692+0000","last_undegraded":"2024-04-17T02:22:23.962692+0000","last_fullsized":"2024-04-17T02:22:23.962692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:45:41.860323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248355+0000","last_change":"2024-04-17T02:22:22.258839+0000","last_active":"2024-04-17T02:22:23.248355+0000","last_peered":"2024-04-17T02:22:23.248355+0000","last_clean":"2024-04-17T02:22:23.248355+0000","last_became_active":"2024-04-17T02:22:22.257715+0000","last_became_peered":"2024-04-17T02:22:22.257715+0000","last_unstale":"2024-04-17T02:22:23.248355+0000","last_undegraded":"2024-04-17T02:22:23.248355+0000","last_fullsized":"2024-04-17T02:22:23.248355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:26:13.695328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247496+0000","last_change":"2024-04-17T02:22:22.259395+0000","last_active":"2024-04-17T02:22:23.247496+0000","last_peered":"2024-04-17T02:22:23.247496+0000","last_clean":"2024-04-17T02:22:23.247496+0000","last_became_active":"2024-04-17T02:22:22.258508+0000","last_became_peered":"2024-04-17T02:22:22.258508+0000","last_unstale":"2024-04-17T02:22:23.247496+0000","last_undegraded":"2024-04-17T02:22:23.247496+0000","last_fullsized":"2024-04-17T02:22:23.247496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:34:29.435312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248096+0000","last_change":"2024-04-17T02:22:22.261760+0000","last_active":"2024-04-17T02:22:23.248096+0000","last_peered":"2024-04-17T02:22:23.248096+0000","last_clean":"2024-04-17T02:22:23.248096+0000","last_became_active":"2024-04-17T02:22:22.261501+0000","last_became_peered":"2024-04-17T02:22:22.261501+0000","last_unstale":"2024-04-17T02:22:23.248096+0000","last_undegraded":"2024-04-17T02:22:23.248096+0000","last_fullsized":"2024-04-17T02:22:23.248096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:07:20.363260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.244553+0000","last_change":"2024-04-17T02:22:22.257716+0000","last_active":"2024-04-17T02:22:23.244553+0000","last_peered":"2024-04-17T02:22:23.244553+0000","last_clean":"2024-04-17T02:22:23.244553+0000","last_became_active":"2024-04-17T02:22:22.257354+0000","last_became_peered":"2024-04-17T02:22:22.257354+0000","last_unstale":"2024-04-17T02:22:23.244553+0000","last_undegraded":"2024-04-17T02:22:23.244553+0000","last_fullsized":"2024-04-17T02:22:23.244553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:45:35.746928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247533+0000","last_change":"2024-04-17T02:22:22.261339+0000","last_active":"2024-04-17T02:22:23.247533+0000","last_peered":"2024-04-17T02:22:23.247533+0000","last_clean":"2024-04-17T02:22:23.247533+0000","last_became_active":"2024-04-17T02:22:22.258124+0000","last_became_peered":"2024-04-17T02:22:22.258124+0000","last_unstale":"2024-04-17T02:22:23.247533+0000","last_undegraded":"2024-04-17T02:22:23.247533+0000","last_fullsized":"2024-04-17T02:22:23.247533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:31:34.863748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962968+0000","last_change":"2024-04-17T02:22:22.276919+0000","last_active":"2024-04-17T02:22:23.962968+0000","last_peered":"2024-04-17T02:22:23.962968+0000","last_clean":"2024-04-17T02:22:23.962968+0000","last_became_active":"2024-04-17T02:22:22.273911+0000","last_became_peered":"2024-04-17T02:22:22.273911+0000","last_unstale":"2024-04-17T02:22:23.962968+0000","last_undegraded":"2024-04-17T02:22:23.962968+0000","last_fullsized":"2024-04-17T02:22:23.962968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:33:01.850142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962960+0000","last_change":"2024-04-17T02:22:22.269997+0000","last_active":"2024-04-17T02:22:23.962960+0000","last_peered":"2024-04-17T02:22:23.962960+0000","last_clean":"2024-04-17T02:22:23.962960+0000","last_became_active":"2024-04-17T02:22:22.269071+0000","last_became_peered":"2024-04-17T02:22:22.269071+0000","last_unstale":"2024-04-17T02:22:23.962960+0000","last_undegraded":"2024-04-17T02:22:23.962960+0000","last_fullsized":"2024-04-17T02:22:23.962960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:28:17.292009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246781+0000","last_change":"2024-04-17T02:22:22.255449+0000","last_active":"2024-04-17T02:22:23.246781+0000","last_peered":"2024-04-17T02:22:23.246781+0000","last_clean":"2024-04-17T02:22:23.246781+0000","last_became_active":"2024-04-17T02:22:22.254619+0000","last_became_peered":"2024-04-17T02:22:22.254619+0000","last_unstale":"2024-04-17T02:22:23.246781+0000","last_undegraded":"2024-04-17T02:22:23.246781+0000","last_fullsized":"2024-04-17T02:22:23.246781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:29:09.389819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246450+0000","last_change":"2024-04-17T02:22:22.257767+0000","last_active":"2024-04-17T02:22:23.246450+0000","last_peered":"2024-04-17T02:22:23.246450+0000","last_clean":"2024-04-17T02:22:23.246450+0000","last_became_active":"2024-04-17T02:22:22.257506+0000","last_became_peered":"2024-04-17T02:22:22.257506+0000","last_unstale":"2024-04-17T02:22:23.246450+0000","last_undegraded":"2024-04-17T02:22:23.246450+0000","last_fullsized":"2024-04-17T02:22:23.246450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:36:11.795618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245156+0000","last_change":"2024-04-17T02:22:22.254083+0000","last_active":"2024-04-17T02:22:23.245156+0000","last_peered":"2024-04-17T02:22:23.245156+0000","last_clean":"2024-04-17T02:22:23.245156+0000","last_became_active":"2024-04-17T02:22:22.253756+0000","last_became_peered":"2024-04-17T02:22:22.253756+0000","last_unstale":"2024-04-17T02:22:23.245156+0000","last_undegraded":"2024-04-17T02:22:23.245156+0000","last_fullsized":"2024-04-17T02:22:23.245156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:55:12.334737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.244837+0000","last_change":"2024-04-17T02:22:22.269407+0000","last_active":"2024-04-17T02:22:23.244837+0000","last_peered":"2024-04-17T02:22:23.244837+0000","last_clean":"2024-04-17T02:22:23.244837+0000","last_became_active":"2024-04-17T02:22:22.269130+0000","last_became_peered":"2024-04-17T02:22:22.269130+0000","last_unstale":"2024-04-17T02:22:23.244837+0000","last_undegraded":"2024-04-17T02:22:23.244837+0000","last_fullsized":"2024-04-17T02:22:23.244837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:44:17.761493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.244638+0000","last_change":"2024-04-17T02:22:22.257257+0000","last_active":"2024-04-17T02:22:23.244638+0000","last_peered":"2024-04-17T02:22:23.244638+0000","last_clean":"2024-04-17T02:22:23.244638+0000","last_became_active":"2024-04-17T02:22:22.256498+0000","last_became_peered":"2024-04-17T02:22:22.256498+0000","last_unstale":"2024-04-17T02:22:23.244638+0000","last_undegraded":"2024-04-17T02:22:23.244638+0000","last_fullsized":"2024-04-17T02:22:23.244638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:09:57.616528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963373+0000","last_change":"2024-04-17T02:22:22.273771+0000","last_active":"2024-04-17T02:22:23.963373+0000","last_peered":"2024-04-17T02:22:23.963373+0000","last_clean":"2024-04-17T02:22:23.963373+0000","last_became_active":"2024-04-17T02:22:22.273403+0000","last_became_peered":"2024-04-17T02:22:22.273403+0000","last_unstale":"2024-04-17T02:22:23.963373+0000","last_undegraded":"2024-04-17T02:22:23.963373+0000","last_fullsized":"2024-04-17T02:22:23.963373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:43:59.776760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248116+0000","last_change":"2024-04-17T02:22:22.258817+0000","last_active":"2024-04-17T02:22:23.248116+0000","last_peered":"2024-04-17T02:22:23.248116+0000","last_clean":"2024-04-17T02:22:23.248116+0000","last_became_active":"2024-04-17T02:22:22.258461+0000","last_became_peered":"2024-04-17T02:22:22.258461+0000","last_unstale":"2024-04-17T02:22:23.248116+0000","last_undegraded":"2024-04-17T02:22:23.248116+0000","last_fullsized":"2024-04-17T02:22:23.248116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:24:39.123134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246891+0000","last_change":"2024-04-17T02:22:22.260864+0000","last_active":"2024-04-17T02:22:23.246891+0000","last_peered":"2024-04-17T02:22:23.246891+0000","last_clean":"2024-04-17T02:22:23.246891+0000","last_became_active":"2024-04-17T02:22:22.260605+0000","last_became_peered":"2024-04-17T02:22:22.260605+0000","last_unstale":"2024-04-17T02:22:23.246891+0000","last_undegraded":"2024-04-17T02:22:23.246891+0000","last_fullsized":"2024-04-17T02:22:23.246891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:24:43.421842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962806+0000","last_change":"2024-04-17T02:22:22.271849+0000","last_active":"2024-04-17T02:22:23.962806+0000","last_peered":"2024-04-17T02:22:23.962806+0000","last_clean":"2024-04-17T02:22:23.962806+0000","last_became_active":"2024-04-17T02:22:22.270030+0000","last_became_peered":"2024-04-17T02:22:22.270030+0000","last_unstale":"2024-04-17T02:22:23.962806+0000","last_undegraded":"2024-04-17T02:22:23.962806+0000","last_fullsized":"2024-04-17T02:22:23.962806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:26:13.695328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245164+0000","last_change":"2024-04-17T02:22:22.255249+0000","last_active":"2024-04-17T02:22:23.245164+0000","last_peered":"2024-04-17T02:22:23.245164+0000","last_clean":"2024-04-17T02:22:23.245164+0000","last_became_active":"2024-04-17T02:22:22.254964+0000","last_became_peered":"2024-04-17T02:22:22.254964+0000","last_unstale":"2024-04-17T02:22:23.245164+0000","last_undegraded":"2024-04-17T02:22:23.245164+0000","last_fullsized":"2024-04-17T02:22:23.245164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:08:08.804961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962272+0000","last_change":"2024-04-17T02:22:22.277803+0000","last_active":"2024-04-17T02:22:23.962272+0000","last_peered":"2024-04-17T02:22:23.962272+0000","last_clean":"2024-04-17T02:22:23.962272+0000","last_became_active":"2024-04-17T02:22:22.277509+0000","last_became_peered":"2024-04-17T02:22:22.277509+0000","last_unstale":"2024-04-17T02:22:23.962272+0000","last_undegraded":"2024-04-17T02:22:23.962272+0000","last_fullsized":"2024-04-17T02:22:23.962272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:40:01.962151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248329+0000","last_change":"2024-04-17T02:22:22.274201+0000","last_active":"2024-04-17T02:22:23.248329+0000","last_peered":"2024-04-17T02:22:23.248329+0000","last_clean":"2024-04-17T02:22:23.248329+0000","last_became_active":"2024-04-17T02:22:22.273832+0000","last_became_peered":"2024-04-17T02:22:22.273832+0000","last_unstale":"2024-04-17T02:22:23.248329+0000","last_undegraded":"2024-04-17T02:22:23.248329+0000","last_fullsized":"2024-04-17T02:22:23.248329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:45:41.860323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.244683+0000","last_change":"2024-04-17T02:22:22.250494+0000","last_active":"2024-04-17T02:22:23.244683+0000","last_peered":"2024-04-17T02:22:23.244683+0000","last_clean":"2024-04-17T02:22:23.244683+0000","last_became_active":"2024-04-17T02:22:22.250080+0000","last_became_peered":"2024-04-17T02:22:22.250080+0000","last_unstale":"2024-04-17T02:22:23.244683+0000","last_undegraded":"2024-04-17T02:22:23.244683+0000","last_fullsized":"2024-04-17T02:22:23.244683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:35:24.036979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963005+0000","last_change":"2024-04-17T02:22:22.274842+0000","last_active":"2024-04-17T02:22:23.963005+0000","last_peered":"2024-04-17T02:22:23.963005+0000","last_clean":"2024-04-17T02:22:23.963005+0000","last_became_active":"2024-04-17T02:22:22.273726+0000","last_became_peered":"2024-04-17T02:22:22.273726+0000","last_unstale":"2024-04-17T02:22:23.963005+0000","last_undegraded":"2024-04-17T02:22:23.963005+0000","last_fullsized":"2024-04-17T02:22:23.963005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:45:35.746928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963211+0000","last_change":"2024-04-17T02:22:22.273623+0000","last_active":"2024-04-17T02:22:23.963211+0000","last_peered":"2024-04-17T02:22:23.963211+0000","last_clean":"2024-04-17T02:22:23.963211+0000","last_became_active":"2024-04-17T02:22:22.273324+0000","last_became_peered":"2024-04-17T02:22:22.273324+0000","last_unstale":"2024-04-17T02:22:23.963211+0000","last_undegraded":"2024-04-17T02:22:23.963211+0000","last_fullsized":"2024-04-17T02:22:23.963211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:55:12.334737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246237+0000","last_change":"2024-04-17T02:22:22.259990+0000","last_active":"2024-04-17T02:22:23.246237+0000","last_peered":"2024-04-17T02:22:23.246237+0000","last_clean":"2024-04-17T02:22:23.246237+0000","last_became_active":"2024-04-17T02:22:22.259635+0000","last_became_peered":"2024-04-17T02:22:22.259635+0000","last_unstale":"2024-04-17T02:22:23.246237+0000","last_undegraded":"2024-04-17T02:22:23.246237+0000","last_fullsized":"2024-04-17T02:22:23.246237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:38:51.312268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963321+0000","last_change":"2024-04-17T02:22:22.269783+0000","last_active":"2024-04-17T02:22:23.963321+0000","last_peered":"2024-04-17T02:22:23.963321+0000","last_clean":"2024-04-17T02:22:23.963321+0000","last_became_active":"2024-04-17T02:22:22.269006+0000","last_became_peered":"2024-04-17T02:22:22.269006+0000","last_unstale":"2024-04-17T02:22:23.963321+0000","last_undegraded":"2024-04-17T02:22:23.963321+0000","last_fullsized":"2024-04-17T02:22:23.963321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:08:08.804961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248147+0000","last_change":"2024-04-17T02:22:22.258194+0000","last_active":"2024-04-17T02:22:23.248147+0000","last_peered":"2024-04-17T02:22:23.248147+0000","last_clean":"2024-04-17T02:22:23.248147+0000","last_became_active":"2024-04-17T02:22:22.257344+0000","last_became_peered":"2024-04-17T02:22:22.257344+0000","last_unstale":"2024-04-17T02:22:23.248147+0000","last_undegraded":"2024-04-17T02:22:23.248147+0000","last_fullsized":"2024-04-17T02:22:23.248147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:12:23.134715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962539+0000","last_change":"2024-04-17T02:22:22.276867+0000","last_active":"2024-04-17T02:22:23.962539+0000","last_peered":"2024-04-17T02:22:23.962539+0000","last_clean":"2024-04-17T02:22:23.962539+0000","last_became_active":"2024-04-17T02:22:22.273911+0000","last_became_peered":"2024-04-17T02:22:22.273911+0000","last_unstale":"2024-04-17T02:22:23.962539+0000","last_undegraded":"2024-04-17T02:22:23.962539+0000","last_fullsized":"2024-04-17T02:22:23.962539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:12:23.134715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248369+0000","last_change":"2024-04-17T02:22:22.274573+0000","last_active":"2024-04-17T02:22:23.248369+0000","last_peered":"2024-04-17T02:22:23.248369+0000","last_clean":"2024-04-17T02:22:23.248369+0000","last_became_active":"2024-04-17T02:22:22.274287+0000","last_became_peered":"2024-04-17T02:22:22.274287+0000","last_unstale":"2024-04-17T02:22:23.248369+0000","last_undegraded":"2024-04-17T02:22:23.248369+0000","last_fullsized":"2024-04-17T02:22:23.248369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:02:38.660756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.244774+0000","last_change":"2024-04-17T02:22:22.249744+0000","last_active":"2024-04-17T02:22:23.244774+0000","last_peered":"2024-04-17T02:22:23.244774+0000","last_clean":"2024-04-17T02:22:23.244774+0000","last_became_active":"2024-04-17T02:22:22.249456+0000","last_became_peered":"2024-04-17T02:22:22.249456+0000","last_unstale":"2024-04-17T02:22:23.244774+0000","last_undegraded":"2024-04-17T02:22:23.244774+0000","last_fullsized":"2024-04-17T02:22:23.244774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:58:55.176237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247534+0000","last_change":"2024-04-17T02:22:22.276822+0000","last_active":"2024-04-17T02:22:23.247534+0000","last_peered":"2024-04-17T02:22:23.247534+0000","last_clean":"2024-04-17T02:22:23.247534+0000","last_became_active":"2024-04-17T02:22:22.276565+0000","last_became_peered":"2024-04-17T02:22:22.276565+0000","last_unstale":"2024-04-17T02:22:23.247534+0000","last_undegraded":"2024-04-17T02:22:23.247534+0000","last_fullsized":"2024-04-17T02:22:23.247534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:00:17.976771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248519+0000","last_change":"2024-04-17T02:22:21.260392+0000","last_active":"2024-04-17T02:22:23.248519+0000","last_peered":"2024-04-17T02:22:23.248519+0000","last_clean":"2024-04-17T02:22:23.248519+0000","last_became_active":"2024-04-17T02:22:21.259347+0000","last_became_peered":"2024-04-17T02:22:21.259347+0000","last_unstale":"2024-04-17T02:22:23.248519+0000","last_undegraded":"2024-04-17T02:22:23.248519+0000","last_fullsized":"2024-04-17T02:22:23.248519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:07:12.265185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248186+0000","last_change":"2024-04-17T02:22:22.260150+0000","last_active":"2024-04-17T02:22:23.248186+0000","last_peered":"2024-04-17T02:22:23.248186+0000","last_clean":"2024-04-17T02:22:23.248186+0000","last_became_active":"2024-04-17T02:22:22.259875+0000","last_became_peered":"2024-04-17T02:22:22.259875+0000","last_unstale":"2024-04-17T02:22:23.248186+0000","last_undegraded":"2024-04-17T02:22:23.248186+0000","last_fullsized":"2024-04-17T02:22:23.248186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:59:56.366536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246343+0000","last_change":"2024-04-17T02:22:21.252345+0000","last_active":"2024-04-17T02:22:23.246343+0000","last_peered":"2024-04-17T02:22:23.246343+0000","last_clean":"2024-04-17T02:22:23.246343+0000","last_became_active":"2024-04-17T02:22:21.252035+0000","last_became_peered":"2024-04-17T02:22:21.252035+0000","last_unstale":"2024-04-17T02:22:23.246343+0000","last_undegraded":"2024-04-17T02:22:23.246343+0000","last_fullsized":"2024-04-17T02:22:23.246343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:00:58.747974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248224+0000","last_change":"2024-04-17T02:22:22.277830+0000","last_active":"2024-04-17T02:22:23.248224+0000","last_peered":"2024-04-17T02:22:23.248224+0000","last_clean":"2024-04-17T02:22:23.248224+0000","last_became_active":"2024-04-17T02:22:22.277558+0000","last_became_peered":"2024-04-17T02:22:22.277558+0000","last_unstale":"2024-04-17T02:22:23.248224+0000","last_undegraded":"2024-04-17T02:22:23.248224+0000","last_fullsized":"2024-04-17T02:22:23.248224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:06:11.399207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.244931+0000","last_change":"2024-04-17T02:22:21.257436+0000","last_active":"2024-04-17T02:22:23.244931+0000","last_peered":"2024-04-17T02:22:23.244931+0000","last_clean":"2024-04-17T02:22:23.244931+0000","last_became_active":"2024-04-17T02:22:21.256912+0000","last_became_peered":"2024-04-17T02:22:21.256912+0000","last_unstale":"2024-04-17T02:22:23.244931+0000","last_undegraded":"2024-04-17T02:22:23.244931+0000","last_fullsized":"2024-04-17T02:22:23.244931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:24:42.419846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248533+0000","last_change":"2024-04-17T02:22:22.278083+0000","last_active":"2024-04-17T02:22:23.248533+0000","last_peered":"2024-04-17T02:22:23.248533+0000","last_clean":"2024-04-17T02:22:23.248533+0000","last_became_active":"2024-04-17T02:22:22.277838+0000","last_became_peered":"2024-04-17T02:22:22.277838+0000","last_unstale":"2024-04-17T02:22:23.248533+0000","last_undegraded":"2024-04-17T02:22:23.248533+0000","last_fullsized":"2024-04-17T02:22:23.248533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:28:17.292009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.244776+0000","last_change":"2024-04-17T02:22:21.264203+0000","last_active":"2024-04-17T02:22:23.244776+0000","last_peered":"2024-04-17T02:22:23.244776+0000","last_clean":"2024-04-17T02:22:23.244776+0000","last_became_active":"2024-04-17T02:22:21.263926+0000","last_became_peered":"2024-04-17T02:22:21.263926+0000","last_unstale":"2024-04-17T02:22:23.244776+0000","last_undegraded":"2024-04-17T02:22:23.244776+0000","last_fullsized":"2024-04-17T02:22:23.244776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:12:51.802467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245897+0000","last_change":"2024-04-17T02:22:21.262253+0000","last_active":"2024-04-17T02:22:23.245897+0000","last_peered":"2024-04-17T02:22:23.245897+0000","last_clean":"2024-04-17T02:22:23.245897+0000","last_became_active":"2024-04-17T02:22:21.261336+0000","last_became_peered":"2024-04-17T02:22:21.261336+0000","last_unstale":"2024-04-17T02:22:23.245897+0000","last_undegraded":"2024-04-17T02:22:23.245897+0000","last_fullsized":"2024-04-17T02:22:23.245897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:20:13.640602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247204+0000","last_change":"2024-04-17T02:22:22.259672+0000","last_active":"2024-04-17T02:22:23.247204+0000","last_peered":"2024-04-17T02:22:23.247204+0000","last_clean":"2024-04-17T02:22:23.247204+0000","last_became_active":"2024-04-17T02:22:22.259407+0000","last_became_peered":"2024-04-17T02:22:22.259407+0000","last_unstale":"2024-04-17T02:22:23.247204+0000","last_undegraded":"2024-04-17T02:22:23.247204+0000","last_fullsized":"2024-04-17T02:22:23.247204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:56:41.058446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246089+0000","last_change":"2024-04-17T02:22:21.251579+0000","last_active":"2024-04-17T02:22:23.246089+0000","last_peered":"2024-04-17T02:22:23.246089+0000","last_clean":"2024-04-17T02:22:23.246089+0000","last_became_active":"2024-04-17T02:22:21.251330+0000","last_became_peered":"2024-04-17T02:22:21.251330+0000","last_unstale":"2024-04-17T02:22:23.246089+0000","last_undegraded":"2024-04-17T02:22:23.246089+0000","last_fullsized":"2024-04-17T02:22:23.246089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:30:22.630029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962294+0000","last_change":"2024-04-17T02:22:22.270839+0000","last_active":"2024-04-17T02:22:23.962294+0000","last_peered":"2024-04-17T02:22:23.962294+0000","last_clean":"2024-04-17T02:22:23.962294+0000","last_became_active":"2024-04-17T02:22:22.268977+0000","last_became_peered":"2024-04-17T02:22:22.268977+0000","last_unstale":"2024-04-17T02:22:23.962294+0000","last_undegraded":"2024-04-17T02:22:23.962294+0000","last_fullsized":"2024-04-17T02:22:23.962294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:07:20.363260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246033+0000","last_change":"2024-04-17T02:22:21.256996+0000","last_active":"2024-04-17T02:22:23.246033+0000","last_peered":"2024-04-17T02:22:23.246033+0000","last_clean":"2024-04-17T02:22:23.246033+0000","last_became_active":"2024-04-17T02:22:21.256082+0000","last_became_peered":"2024-04-17T02:22:21.256082+0000","last_unstale":"2024-04-17T02:22:23.246033+0000","last_undegraded":"2024-04-17T02:22:23.246033+0000","last_fullsized":"2024-04-17T02:22:23.246033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:42:14.419225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245472+0000","last_change":"2024-04-17T02:22:22.258273+0000","last_active":"2024-04-17T02:22:23.245472+0000","last_peered":"2024-04-17T02:22:23.245472+0000","last_clean":"2024-04-17T02:22:23.245472+0000","last_became_active":"2024-04-17T02:22:22.257818+0000","last_became_peered":"2024-04-17T02:22:22.257818+0000","last_unstale":"2024-04-17T02:22:23.245472+0000","last_undegraded":"2024-04-17T02:22:23.245472+0000","last_fullsized":"2024-04-17T02:22:23.245472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:45:43.904195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245616+0000","last_change":"2024-04-17T02:22:21.250003+0000","last_active":"2024-04-17T02:22:23.245616+0000","last_peered":"2024-04-17T02:22:23.245616+0000","last_clean":"2024-04-17T02:22:23.245616+0000","last_became_active":"2024-04-17T02:22:21.249709+0000","last_became_peered":"2024-04-17T02:22:21.249709+0000","last_unstale":"2024-04-17T02:22:23.245616+0000","last_undegraded":"2024-04-17T02:22:23.245616+0000","last_fullsized":"2024-04-17T02:22:23.245616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:56:40.377974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246786+0000","last_change":"2024-04-17T02:22:22.255008+0000","last_active":"2024-04-17T02:22:23.246786+0000","last_peered":"2024-04-17T02:22:23.246786+0000","last_clean":"2024-04-17T02:22:23.246786+0000","last_became_active":"2024-04-17T02:22:22.254689+0000","last_became_peered":"2024-04-17T02:22:22.254689+0000","last_unstale":"2024-04-17T02:22:23.246786+0000","last_undegraded":"2024-04-17T02:22:23.246786+0000","last_fullsized":"2024-04-17T02:22:23.246786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:05:18.321177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248616+0000","last_change":"2024-04-17T02:22:21.265269+0000","last_active":"2024-04-17T02:22:23.248616+0000","last_peered":"2024-04-17T02:22:23.248616+0000","last_clean":"2024-04-17T02:22:23.248616+0000","last_became_active":"2024-04-17T02:22:21.264981+0000","last_became_peered":"2024-04-17T02:22:21.264981+0000","last_unstale":"2024-04-17T02:22:23.248616+0000","last_undegraded":"2024-04-17T02:22:23.248616+0000","last_fullsized":"2024-04-17T02:22:23.248616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:27:52.759868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962935+0000","last_change":"2024-04-17T02:22:22.271981+0000","last_active":"2024-04-17T02:22:23.962935+0000","last_peered":"2024-04-17T02:22:23.962935+0000","last_clean":"2024-04-17T02:22:23.962935+0000","last_became_active":"2024-04-17T02:22:22.270317+0000","last_became_peered":"2024-04-17T02:22:22.270317+0000","last_unstale":"2024-04-17T02:22:23.962935+0000","last_undegraded":"2024-04-17T02:22:23.962935+0000","last_fullsized":"2024-04-17T02:22:23.962935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:02:38.660756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245901+0000","last_change":"2024-04-17T02:22:21.262438+0000","last_active":"2024-04-17T02:22:23.245901+0000","last_peered":"2024-04-17T02:22:23.245901+0000","last_clean":"2024-04-17T02:22:23.245901+0000","last_became_active":"2024-04-17T02:22:21.261470+0000","last_became_peered":"2024-04-17T02:22:21.261470+0000","last_unstale":"2024-04-17T02:22:23.245901+0000","last_undegraded":"2024-04-17T02:22:23.245901+0000","last_fullsized":"2024-04-17T02:22:23.245901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:22:02.248276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245775+0000","last_change":"2024-04-17T02:22:22.255994+0000","last_active":"2024-04-17T02:22:23.245775+0000","last_peered":"2024-04-17T02:22:23.245775+0000","last_clean":"2024-04-17T02:22:23.245775+0000","last_became_active":"2024-04-17T02:22:22.255089+0000","last_became_peered":"2024-04-17T02:22:22.255089+0000","last_unstale":"2024-04-17T02:22:23.245775+0000","last_undegraded":"2024-04-17T02:22:23.245775+0000","last_fullsized":"2024-04-17T02:22:23.245775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:50:00.777691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248497+0000","last_change":"2024-04-17T02:22:21.259659+0000","last_active":"2024-04-17T02:22:23.248497+0000","last_peered":"2024-04-17T02:22:23.248497+0000","last_clean":"2024-04-17T02:22:23.248497+0000","last_became_active":"2024-04-17T02:22:21.259030+0000","last_became_peered":"2024-04-17T02:22:21.259030+0000","last_unstale":"2024-04-17T02:22:23.248497+0000","last_undegraded":"2024-04-17T02:22:23.248497+0000","last_fullsized":"2024-04-17T02:22:23.248497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:43:22.970177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247238+0000","last_change":"2024-04-17T02:22:22.254414+0000","last_active":"2024-04-17T02:22:23.247238+0000","last_peered":"2024-04-17T02:22:23.247238+0000","last_clean":"2024-04-17T02:22:23.247238+0000","last_became_active":"2024-04-17T02:22:22.253963+0000","last_became_peered":"2024-04-17T02:22:22.253963+0000","last_unstale":"2024-04-17T02:22:23.247238+0000","last_undegraded":"2024-04-17T02:22:23.247238+0000","last_fullsized":"2024-04-17T02:22:23.247238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:56:41.379971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247417+0000","last_change":"2024-04-17T02:22:21.266419+0000","last_active":"2024-04-17T02:22:23.247417+0000","last_peered":"2024-04-17T02:22:23.247417+0000","last_clean":"2024-04-17T02:22:23.247417+0000","last_became_active":"2024-04-17T02:22:21.266123+0000","last_became_peered":"2024-04-17T02:22:21.266123+0000","last_unstale":"2024-04-17T02:22:23.247417+0000","last_undegraded":"2024-04-17T02:22:23.247417+0000","last_fullsized":"2024-04-17T02:22:23.247417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:06:57.393992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963114+0000","last_change":"2024-04-17T02:22:22.277085+0000","last_active":"2024-04-17T02:22:23.963114+0000","last_peered":"2024-04-17T02:22:23.963114+0000","last_clean":"2024-04-17T02:22:23.963114+0000","last_became_active":"2024-04-17T02:22:22.275396+0000","last_became_peered":"2024-04-17T02:22:22.275396+0000","last_unstale":"2024-04-17T02:22:23.963114+0000","last_undegraded":"2024-04-17T02:22:23.963114+0000","last_fullsized":"2024-04-17T02:22:23.963114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:35:24.036979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":176,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962291+0000","last_change":"2024-04-17T02:22:12.100529+0000","last_active":"2024-04-17T02:22:23.962291+0000","last_peered":"2024-04-17T02:22:23.962291+0000","last_clean":"2024-04-17T02:22:23.962291+0000","last_became_active":"2024-04-17T02:22:12.100191+0000","last_became_peered":"2024-04-17T02:22:12.100191+0000","last_unstale":"2024-04-17T02:22:23.962291+0000","last_undegraded":"2024-04-17T02:22:23.962291+0000","last_fullsized":"2024-04-17T02:22:23.962291+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:11.088733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:11.088733+0000","last_clean_scrub_stamp":"2024-04-17T02:22:11.088733+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:47:32.959035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245357+0000","last_change":"2024-04-17T02:22:17.123965+0000","last_active":"2024-04-17T02:22:23.245357+0000","last_peered":"2024-04-17T02:22:23.245357+0000","last_clean":"2024-04-17T02:22:23.245357+0000","last_became_active":"2024-04-17T02:22:17.123282+0000","last_became_peered":"2024-04-17T02:22:17.123282+0000","last_unstale":"2024-04-17T02:22:23.245357+0000","last_undegraded":"2024-04-17T02:22:23.245357+0000","last_fullsized":"2024-04-17T02:22:23.245357+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:00:54.621590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247944+0000","last_change":"2024-04-17T02:22:21.259046+0000","last_active":"2024-04-17T02:22:23.247944+0000","last_peered":"2024-04-17T02:22:23.247944+0000","last_clean":"2024-04-17T02:22:23.247944+0000","last_became_active":"2024-04-17T02:22:21.258750+0000","last_became_peered":"2024-04-17T02:22:21.258750+0000","last_unstale":"2024-04-17T02:22:23.247944+0000","last_undegraded":"2024-04-17T02:22:23.247944+0000","last_fullsized":"2024-04-17T02:22:23.247944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:21:58.622774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246098+0000","last_change":"2024-04-17T02:22:22.256960+0000","last_active":"2024-04-17T02:22:23.246098+0000","last_peered":"2024-04-17T02:22:23.246098+0000","last_clean":"2024-04-17T02:22:23.246098+0000","last_became_active":"2024-04-17T02:22:22.256613+0000","last_became_peered":"2024-04-17T02:22:22.256613+0000","last_unstale":"2024-04-17T02:22:23.246098+0000","last_undegraded":"2024-04-17T02:22:23.246098+0000","last_fullsized":"2024-04-17T02:22:23.246098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:32:56.166132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.244846+0000","last_change":"2024-04-17T02:22:17.123918+0000","last_active":"2024-04-17T02:22:23.244846+0000","last_peered":"2024-04-17T02:22:23.244846+0000","last_clean":"2024-04-17T02:22:23.244846+0000","last_became_active":"2024-04-17T02:22:17.123423+0000","last_became_peered":"2024-04-17T02:22:17.123423+0000","last_unstale":"2024-04-17T02:22:23.244846+0000","last_undegraded":"2024-04-17T02:22:23.244846+0000","last_fullsized":"2024-04-17T02:22:23.244846+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:25:53.024970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962441+0000","last_change":"2024-04-17T02:22:21.260085+0000","last_active":"2024-04-17T02:22:23.962441+0000","last_peered":"2024-04-17T02:22:23.962441+0000","last_clean":"2024-04-17T02:22:23.962441+0000","last_became_active":"2024-04-17T02:22:21.259738+0000","last_became_peered":"2024-04-17T02:22:21.259738+0000","last_unstale":"2024-04-17T02:22:23.962441+0000","last_undegraded":"2024-04-17T02:22:23.962441+0000","last_fullsized":"2024-04-17T02:22:23.962441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:34:47.001187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247930+0000","last_change":"2024-04-17T02:22:22.276216+0000","last_active":"2024-04-17T02:22:23.247930+0000","last_peered":"2024-04-17T02:22:23.247930+0000","last_clean":"2024-04-17T02:22:23.247930+0000","last_became_active":"2024-04-17T02:22:22.275925+0000","last_became_peered":"2024-04-17T02:22:22.275925+0000","last_unstale":"2024-04-17T02:22:23.247930+0000","last_undegraded":"2024-04-17T02:22:23.247930+0000","last_fullsized":"2024-04-17T02:22:23.247930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:12:02.539603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247214+0000","last_change":"2024-04-17T02:22:17.560526+0000","last_active":"2024-04-17T02:22:23.247214+0000","last_peered":"2024-04-17T02:22:23.247214+0000","last_clean":"2024-04-17T02:22:23.247214+0000","last_became_active":"2024-04-17T02:22:17.560120+0000","last_became_peered":"2024-04-17T02:22:17.560120+0000","last_unstale":"2024-04-17T02:22:23.247214+0000","last_undegraded":"2024-04-17T02:22:23.247214+0000","last_fullsized":"2024-04-17T02:22:23.247214+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:49:30.975553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962096+0000","last_change":"2024-04-17T02:22:21.265155+0000","last_active":"2024-04-17T02:22:23.962096+0000","last_peered":"2024-04-17T02:22:23.962096+0000","last_clean":"2024-04-17T02:22:23.962096+0000","last_became_active":"2024-04-17T02:22:21.263791+0000","last_became_peered":"2024-04-17T02:22:21.263791+0000","last_unstale":"2024-04-17T02:22:23.962096+0000","last_undegraded":"2024-04-17T02:22:23.962096+0000","last_fullsized":"2024-04-17T02:22:23.962096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:29:08.387822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963208+0000","last_change":"2024-04-17T02:22:22.275017+0000","last_active":"2024-04-17T02:22:23.963208+0000","last_peered":"2024-04-17T02:22:23.963208+0000","last_clean":"2024-04-17T02:22:23.963208+0000","last_became_active":"2024-04-17T02:22:22.273465+0000","last_became_peered":"2024-04-17T02:22:22.273465+0000","last_unstale":"2024-04-17T02:22:23.963208+0000","last_undegraded":"2024-04-17T02:22:23.963208+0000","last_fullsized":"2024-04-17T02:22:23.963208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:44:17.761493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245862+0000","last_change":"2024-04-17T02:22:17.123761+0000","last_active":"2024-04-17T02:22:23.245862+0000","last_peered":"2024-04-17T02:22:23.245862+0000","last_clean":"2024-04-17T02:22:23.245862+0000","last_became_active":"2024-04-17T02:22:17.123264+0000","last_became_peered":"2024-04-17T02:22:17.123264+0000","last_unstale":"2024-04-17T02:22:23.245862+0000","last_undegraded":"2024-04-17T02:22:23.245862+0000","last_fullsized":"2024-04-17T02:22:23.245862+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:51:28.918451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245315+0000","last_change":"2024-04-17T02:22:21.262295+0000","last_active":"2024-04-17T02:22:23.245315+0000","last_peered":"2024-04-17T02:22:23.245315+0000","last_clean":"2024-04-17T02:22:23.245315+0000","last_became_active":"2024-04-17T02:22:21.261890+0000","last_became_peered":"2024-04-17T02:22:21.261890+0000","last_unstale":"2024-04-17T02:22:23.245315+0000","last_undegraded":"2024-04-17T02:22:23.245315+0000","last_fullsized":"2024-04-17T02:22:23.245315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:31:33.861752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963136+0000","last_change":"2024-04-17T02:22:22.275199+0000","last_active":"2024-04-17T02:22:23.963136+0000","last_peered":"2024-04-17T02:22:23.963136+0000","last_clean":"2024-04-17T02:22:23.963136+0000","last_became_active":"2024-04-17T02:22:22.274892+0000","last_became_peered":"2024-04-17T02:22:22.274892+0000","last_unstale":"2024-04-17T02:22:23.963136+0000","last_undegraded":"2024-04-17T02:22:23.963136+0000","last_fullsized":"2024-04-17T02:22:23.963136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:58:55.176237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246122+0000","last_change":"2024-04-17T02:22:21.256839+0000","last_active":"2024-04-17T02:22:23.246122+0000","last_peered":"2024-04-17T02:22:23.246122+0000","last_clean":"2024-04-17T02:22:23.246122+0000","last_became_active":"2024-04-17T02:22:21.255764+0000","last_became_peered":"2024-04-17T02:22:21.255764+0000","last_unstale":"2024-04-17T02:22:23.246122+0000","last_undegraded":"2024-04-17T02:22:23.246122+0000","last_fullsized":"2024-04-17T02:22:23.246122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:05:15.621470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963324+0000","last_change":"2024-04-17T02:22:17.560478+0000","last_active":"2024-04-17T02:22:23.963324+0000","last_peered":"2024-04-17T02:22:23.963324+0000","last_clean":"2024-04-17T02:22:23.963324+0000","last_became_active":"2024-04-17T02:22:17.560133+0000","last_became_peered":"2024-04-17T02:22:17.560133+0000","last_unstale":"2024-04-17T02:22:23.963324+0000","last_undegraded":"2024-04-17T02:22:23.963324+0000","last_fullsized":"2024-04-17T02:22:23.963324+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:36:01.410663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962278+0000","last_change":"2024-04-17T02:22:22.277210+0000","last_active":"2024-04-17T02:22:23.962278+0000","last_peered":"2024-04-17T02:22:23.962278+0000","last_clean":"2024-04-17T02:22:23.962278+0000","last_became_active":"2024-04-17T02:22:22.275055+0000","last_became_peered":"2024-04-17T02:22:22.275055+0000","last_unstale":"2024-04-17T02:22:23.962278+0000","last_undegraded":"2024-04-17T02:22:23.962278+0000","last_fullsized":"2024-04-17T02:22:23.962278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:59:56.366536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963255+0000","last_change":"2024-04-17T02:22:21.259328+0000","last_active":"2024-04-17T02:22:23.963255+0000","last_peered":"2024-04-17T02:22:23.963255+0000","last_clean":"2024-04-17T02:22:23.963255+0000","last_became_active":"2024-04-17T02:22:21.259133+0000","last_became_peered":"2024-04-17T02:22:21.259133+0000","last_unstale":"2024-04-17T02:22:23.963255+0000","last_undegraded":"2024-04-17T02:22:23.963255+0000","last_fullsized":"2024-04-17T02:22:23.963255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:36:10.793622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246164+0000","last_change":"2024-04-17T02:22:17.124496+0000","last_active":"2024-04-17T02:22:23.246164+0000","last_peered":"2024-04-17T02:22:23.246164+0000","last_clean":"2024-04-17T02:22:23.246164+0000","last_became_active":"2024-04-17T02:22:17.123440+0000","last_became_peered":"2024-04-17T02:22:17.123440+0000","last_unstale":"2024-04-17T02:22:23.246164+0000","last_undegraded":"2024-04-17T02:22:23.246164+0000","last_fullsized":"2024-04-17T02:22:23.246164+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:29:11.971454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962511+0000","last_change":"2024-04-17T02:22:22.268601+0000","last_active":"2024-04-17T02:22:23.962511+0000","last_peered":"2024-04-17T02:22:23.962511+0000","last_clean":"2024-04-17T02:22:23.962511+0000","last_became_active":"2024-04-17T02:22:22.267752+0000","last_became_peered":"2024-04-17T02:22:22.267752+0000","last_unstale":"2024-04-17T02:22:23.962511+0000","last_undegraded":"2024-04-17T02:22:23.962511+0000","last_fullsized":"2024-04-17T02:22:23.962511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:24:39.123134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248403+0000","last_change":"2024-04-17T02:22:21.265332+0000","last_active":"2024-04-17T02:22:23.248403+0000","last_peered":"2024-04-17T02:22:23.248403+0000","last_clean":"2024-04-17T02:22:23.248403+0000","last_became_active":"2024-04-17T02:22:21.265029+0000","last_became_peered":"2024-04-17T02:22:21.265029+0000","last_unstale":"2024-04-17T02:22:23.248403+0000","last_undegraded":"2024-04-17T02:22:23.248403+0000","last_fullsized":"2024-04-17T02:22:23.248403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:34:47.001187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963263+0000","last_change":"2024-04-17T02:22:17.121783+0000","last_active":"2024-04-17T02:22:23.963263+0000","last_peered":"2024-04-17T02:22:23.963263+0000","last_clean":"2024-04-17T02:22:23.963263+0000","last_became_active":"2024-04-17T02:22:17.121502+0000","last_became_peered":"2024-04-17T02:22:17.121502+0000","last_unstale":"2024-04-17T02:22:23.963263+0000","last_undegraded":"2024-04-17T02:22:23.963263+0000","last_fullsized":"2024-04-17T02:22:23.963263+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:05:41.795170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247296+0000","last_change":"2024-04-17T02:22:22.279268+0000","last_active":"2024-04-17T02:22:23.247296+0000","last_peered":"2024-04-17T02:22:23.247296+0000","last_clean":"2024-04-17T02:22:23.247296+0000","last_became_active":"2024-04-17T02:22:22.278986+0000","last_became_peered":"2024-04-17T02:22:22.278986+0000","last_unstale":"2024-04-17T02:22:23.247296+0000","last_undegraded":"2024-04-17T02:22:23.247296+0000","last_fullsized":"2024-04-17T02:22:23.247296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:27:10.507427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:24.246277+0000","last_change":"2024-04-17T02:22:21.261825+0000","last_active":"2024-04-17T02:22:24.246277+0000","last_peered":"2024-04-17T02:22:24.246277+0000","last_clean":"2024-04-17T02:22:24.246277+0000","last_became_active":"2024-04-17T02:22:21.261319+0000","last_became_peered":"2024-04-17T02:22:21.261319+0000","last_unstale":"2024-04-17T02:22:24.246277+0000","last_undegraded":"2024-04-17T02:22:24.246277+0000","last_fullsized":"2024-04-17T02:22:24.246277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:43:22.970177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245937+0000","last_change":"2024-04-17T02:22:17.123744+0000","last_active":"2024-04-17T02:22:23.245937+0000","last_peered":"2024-04-17T02:22:23.245937+0000","last_clean":"2024-04-17T02:22:23.245937+0000","last_became_active":"2024-04-17T02:22:17.123322+0000","last_became_peered":"2024-04-17T02:22:17.123322+0000","last_unstale":"2024-04-17T02:22:23.245937+0000","last_undegraded":"2024-04-17T02:22:23.245937+0000","last_fullsized":"2024-04-17T02:22:23.245937+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:16.106625+0000","last_clean_scrub_stamp":"2024-04-17T02:22:16.106625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:36:41.743830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246504+0000","last_change":"2024-04-17T02:22:22.249162+0000","last_active":"2024-04-17T02:22:23.246504+0000","last_peered":"2024-04-17T02:22:23.246504+0000","last_clean":"2024-04-17T02:22:23.246504+0000","last_became_active":"2024-04-17T02:22:22.248758+0000","last_became_peered":"2024-04-17T02:22:22.248758+0000","last_unstale":"2024-04-17T02:22:23.246504+0000","last_undegraded":"2024-04-17T02:22:23.246504+0000","last_fullsized":"2024-04-17T02:22:23.246504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:18:48.496574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247007+0000","last_change":"2024-04-17T02:22:22.254193+0000","last_active":"2024-04-17T02:22:23.247007+0000","last_peered":"2024-04-17T02:22:23.247007+0000","last_clean":"2024-04-17T02:22:23.247007+0000","last_became_active":"2024-04-17T02:22:22.253786+0000","last_became_peered":"2024-04-17T02:22:22.253786+0000","last_unstale":"2024-04-17T02:22:23.247007+0000","last_undegraded":"2024-04-17T02:22:23.247007+0000","last_fullsized":"2024-04-17T02:22:23.247007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:35:40.664294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245532+0000","last_change":"2024-04-17T02:22:21.248985+0000","last_active":"2024-04-17T02:22:23.245532+0000","last_peered":"2024-04-17T02:22:23.245532+0000","last_clean":"2024-04-17T02:22:23.245532+0000","last_became_active":"2024-04-17T02:22:21.248664+0000","last_became_peered":"2024-04-17T02:22:21.248664+0000","last_unstale":"2024-04-17T02:22:23.245532+0000","last_undegraded":"2024-04-17T02:22:23.245532+0000","last_fullsized":"2024-04-17T02:22:23.245532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:35:39.662298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962584+0000","last_change":"2024-04-17T02:22:22.273634+0000","last_active":"2024-04-17T02:22:23.962584+0000","last_peered":"2024-04-17T02:22:23.962584+0000","last_clean":"2024-04-17T02:22:23.962584+0000","last_became_active":"2024-04-17T02:22:22.273338+0000","last_became_peered":"2024-04-17T02:22:22.273338+0000","last_unstale":"2024-04-17T02:22:23.962584+0000","last_undegraded":"2024-04-17T02:22:23.962584+0000","last_fullsized":"2024-04-17T02:22:23.962584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:06:11.399207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247114+0000","last_change":"2024-04-17T02:22:21.253661+0000","last_active":"2024-04-17T02:22:23.247114+0000","last_peered":"2024-04-17T02:22:23.247114+0000","last_clean":"2024-04-17T02:22:23.247114+0000","last_became_active":"2024-04-17T02:22:21.253375+0000","last_became_peered":"2024-04-17T02:22:21.253375+0000","last_unstale":"2024-04-17T02:22:23.247114+0000","last_undegraded":"2024-04-17T02:22:23.247114+0000","last_fullsized":"2024-04-17T02:22:23.247114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:36:45.870213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245991+0000","last_change":"2024-04-17T02:22:21.261955+0000","last_active":"2024-04-17T02:22:23.245991+0000","last_peered":"2024-04-17T02:22:23.245991+0000","last_clean":"2024-04-17T02:22:23.245991+0000","last_became_active":"2024-04-17T02:22:21.261671+0000","last_became_peered":"2024-04-17T02:22:21.261671+0000","last_unstale":"2024-04-17T02:22:23.245991+0000","last_undegraded":"2024-04-17T02:22:23.245991+0000","last_fullsized":"2024-04-17T02:22:23.245991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:58:48.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248551+0000","last_change":"2024-04-17T02:22:22.259450+0000","last_active":"2024-04-17T02:22:23.248551+0000","last_peered":"2024-04-17T02:22:23.248551+0000","last_clean":"2024-04-17T02:22:23.248551+0000","last_became_active":"2024-04-17T02:22:22.259173+0000","last_became_peered":"2024-04-17T02:22:22.259173+0000","last_unstale":"2024-04-17T02:22:23.248551+0000","last_undegraded":"2024-04-17T02:22:23.248551+0000","last_fullsized":"2024-04-17T02:22:23.248551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:33:01.850142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963409+0000","last_change":"2024-04-17T02:22:21.261243+0000","last_active":"2024-04-17T02:22:23.963409+0000","last_peered":"2024-04-17T02:22:23.963409+0000","last_clean":"2024-04-17T02:22:23.963409+0000","last_became_active":"2024-04-17T02:22:21.260251+0000","last_became_peered":"2024-04-17T02:22:21.260251+0000","last_unstale":"2024-04-17T02:22:23.963409+0000","last_undegraded":"2024-04-17T02:22:23.963409+0000","last_fullsized":"2024-04-17T02:22:23.963409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:04:55.664715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247132+0000","last_change":"2024-04-17T02:22:22.279329+0000","last_active":"2024-04-17T02:22:23.247132+0000","last_peered":"2024-04-17T02:22:23.247132+0000","last_clean":"2024-04-17T02:22:23.247132+0000","last_became_active":"2024-04-17T02:22:22.278952+0000","last_became_peered":"2024-04-17T02:22:22.278952+0000","last_unstale":"2024-04-17T02:22:23.247132+0000","last_undegraded":"2024-04-17T02:22:23.247132+0000","last_fullsized":"2024-04-17T02:22:23.247132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:05:16.623466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245889+0000","last_change":"2024-04-17T02:22:22.259026+0000","last_active":"2024-04-17T02:22:23.245889+0000","last_peered":"2024-04-17T02:22:23.245889+0000","last_clean":"2024-04-17T02:22:23.245889+0000","last_became_active":"2024-04-17T02:22:22.258727+0000","last_became_peered":"2024-04-17T02:22:22.258727+0000","last_unstale":"2024-04-17T02:22:23.245889+0000","last_undegraded":"2024-04-17T02:22:23.245889+0000","last_fullsized":"2024-04-17T02:22:23.245889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:49:55.581353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247317+0000","last_change":"2024-04-17T02:22:21.266400+0000","last_active":"2024-04-17T02:22:23.247317+0000","last_peered":"2024-04-17T02:22:23.247317+0000","last_clean":"2024-04-17T02:22:23.247317+0000","last_became_active":"2024-04-17T02:22:21.266106+0000","last_became_peered":"2024-04-17T02:22:21.266106+0000","last_unstale":"2024-04-17T02:22:23.247317+0000","last_undegraded":"2024-04-17T02:22:23.247317+0000","last_fullsized":"2024-04-17T02:22:23.247317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:17:38.056686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963025+0000","last_change":"2024-04-17T02:22:22.275393+0000","last_active":"2024-04-17T02:22:23.963025+0000","last_peered":"2024-04-17T02:22:23.963025+0000","last_clean":"2024-04-17T02:22:23.963025+0000","last_became_active":"2024-04-17T02:22:22.273656+0000","last_became_peered":"2024-04-17T02:22:22.273656+0000","last_unstale":"2024-04-17T02:22:23.963025+0000","last_undegraded":"2024-04-17T02:22:23.963025+0000","last_fullsized":"2024-04-17T02:22:23.963025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:09:57.616528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.962374+0000","last_change":"2024-04-17T02:22:21.263049+0000","last_active":"2024-04-17T02:22:23.962374+0000","last_peered":"2024-04-17T02:22:23.962374+0000","last_clean":"2024-04-17T02:22:23.962374+0000","last_became_active":"2024-04-17T02:22:21.262318+0000","last_became_peered":"2024-04-17T02:22:21.262318+0000","last_unstale":"2024-04-17T02:22:23.962374+0000","last_undegraded":"2024-04-17T02:22:23.962374+0000","last_fullsized":"2024-04-17T02:22:23.962374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:06:57.393992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.247996+0000","last_change":"2024-04-17T02:22:22.269974+0000","last_active":"2024-04-17T02:22:23.247996+0000","last_peered":"2024-04-17T02:22:23.247996+0000","last_clean":"2024-04-17T02:22:23.247996+0000","last_became_active":"2024-04-17T02:22:22.269670+0000","last_became_peered":"2024-04-17T02:22:22.269670+0000","last_unstale":"2024-04-17T02:22:23.247996+0000","last_undegraded":"2024-04-17T02:22:23.247996+0000","last_fullsized":"2024-04-17T02:22:23.247996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:40:01.962151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245667+0000","last_change":"2024-04-17T02:22:21.264230+0000","last_active":"2024-04-17T02:22:23.245667+0000","last_peered":"2024-04-17T02:22:23.245667+0000","last_clean":"2024-04-17T02:22:23.245667+0000","last_became_active":"2024-04-17T02:22:21.263922+0000","last_became_peered":"2024-04-17T02:22:21.263922+0000","last_unstale":"2024-04-17T02:22:23.245667+0000","last_undegraded":"2024-04-17T02:22:23.245667+0000","last_fullsized":"2024-04-17T02:22:23.245667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:42:08.530787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246821+0000","last_change":"2024-04-17T02:22:22.272294+0000","last_active":"2024-04-17T02:22:23.246821+0000","last_peered":"2024-04-17T02:22:23.246821+0000","last_clean":"2024-04-17T02:22:23.246821+0000","last_became_active":"2024-04-17T02:22:22.272022+0000","last_became_peered":"2024-04-17T02:22:22.272022+0000","last_unstale":"2024-04-17T02:22:23.246821+0000","last_undegraded":"2024-04-17T02:22:23.246821+0000","last_fullsized":"2024-04-17T02:22:23.246821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:04:01.559523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248286+0000","last_change":"2024-04-17T02:22:21.260781+0000","last_active":"2024-04-17T02:22:23.248286+0000","last_peered":"2024-04-17T02:22:23.248286+0000","last_clean":"2024-04-17T02:22:23.248286+0000","last_became_active":"2024-04-17T02:22:21.260216+0000","last_became_peered":"2024-04-17T02:22:21.260216+0000","last_unstale":"2024-04-17T02:22:23.248286+0000","last_undegraded":"2024-04-17T02:22:23.248286+0000","last_fullsized":"2024-04-17T02:22:23.248286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:25:57.151354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.246613+0000","last_change":"2024-04-17T02:22:22.260715+0000","last_active":"2024-04-17T02:22:23.246613+0000","last_peered":"2024-04-17T02:22:23.246613+0000","last_clean":"2024-04-17T02:22:23.246613+0000","last_became_active":"2024-04-17T02:22:22.260292+0000","last_became_peered":"2024-04-17T02:22:22.260292+0000","last_unstale":"2024-04-17T02:22:23.246613+0000","last_undegraded":"2024-04-17T02:22:23.246613+0000","last_fullsized":"2024-04-17T02:22:23.246613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:04:56.666711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963098+0000","last_change":"2024-04-17T02:22:21.263024+0000","last_active":"2024-04-17T02:22:23.963098+0000","last_peered":"2024-04-17T02:22:23.963098+0000","last_clean":"2024-04-17T02:22:23.963098+0000","last_became_active":"2024-04-17T02:22:21.262335+0000","last_became_peered":"2024-04-17T02:22:21.262335+0000","last_unstale":"2024-04-17T02:22:23.963098+0000","last_undegraded":"2024-04-17T02:22:23.963098+0000","last_fullsized":"2024-04-17T02:22:23.963098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:21:11.268956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245289+0000","last_change":"2024-04-17T02:22:22.251488+0000","last_active":"2024-04-17T02:22:23.245289+0000","last_peered":"2024-04-17T02:22:23.245289+0000","last_clean":"2024-04-17T02:22:23.245289+0000","last_became_active":"2024-04-17T02:22:22.251111+0000","last_became_peered":"2024-04-17T02:22:22.251111+0000","last_unstale":"2024-04-17T02:22:23.245289+0000","last_undegraded":"2024-04-17T02:22:23.245289+0000","last_fullsized":"2024-04-17T02:22:23.245289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:43:59.776760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245935+0000","last_change":"2024-04-17T02:22:21.257583+0000","last_active":"2024-04-17T02:22:23.245935+0000","last_peered":"2024-04-17T02:22:23.245935+0000","last_clean":"2024-04-17T02:22:23.245935+0000","last_became_active":"2024-04-17T02:22:21.257330+0000","last_became_peered":"2024-04-17T02:22:21.257330+0000","last_unstale":"2024-04-17T02:22:23.245935+0000","last_undegraded":"2024-04-17T02:22:23.245935+0000","last_fullsized":"2024-04-17T02:22:23.245935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:26:37.106505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248640+0000","last_change":"2024-04-17T02:22:22.264602+0000","last_active":"2024-04-17T02:22:23.248640+0000","last_peered":"2024-04-17T02:22:23.248640+0000","last_clean":"2024-04-17T02:22:23.248640+0000","last_became_active":"2024-04-17T02:22:22.264319+0000","last_became_peered":"2024-04-17T02:22:22.264319+0000","last_unstale":"2024-04-17T02:22:23.248640+0000","last_undegraded":"2024-04-17T02:22:23.248640+0000","last_fullsized":"2024-04-17T02:22:23.248640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:45:35.746928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.248295+0000","last_change":"2024-04-17T02:22:21.259254+0000","last_active":"2024-04-17T02:22:23.248295+0000","last_peered":"2024-04-17T02:22:23.248295+0000","last_clean":"2024-04-17T02:22:23.248295+0000","last_became_active":"2024-04-17T02:22:21.258944+0000","last_became_peered":"2024-04-17T02:22:21.258944+0000","last_unstale":"2024-04-17T02:22:23.248295+0000","last_undegraded":"2024-04-17T02:22:23.248295+0000","last_fullsized":"2024-04-17T02:22:23.248295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:21:11.268956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.245623+0000","last_change":"2024-04-17T02:22:22.276249+0000","last_active":"2024-04-17T02:22:23.245623+0000","last_peered":"2024-04-17T02:22:23.245623+0000","last_clean":"2024-04-17T02:22:23.245623+0000","last_became_active":"2024-04-17T02:22:22.275817+0000","last_became_peered":"2024-04-17T02:22:22.275817+0000","last_unstale":"2024-04-17T02:22:23.245623+0000","last_undegraded":"2024-04-17T02:22:23.245623+0000","last_fullsized":"2024-04-17T02:22:23.245623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:21.235005+0000","last_clean_scrub_stamp":"2024-04-17T02:22:21.235005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:44:37.302631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-17T02:22:23.963340+0000","last_change":"2024-04-17T02:22:21.260966+0000","last_active":"2024-04-17T02:22:23.963340+0000","last_peered":"2024-04-17T02:22:23.963340+0000","last_clean":"2024-04-17T02:22:23.963340+0000","last_became_active":"2024-04-17T02:22:21.260540+0000","last_became_peered":"2024-04-17T02:22:21.260540+0000","last_unstale":"2024-04-17T02:22:23.963340+0000","last_undegraded":"2024-04-17T02:22:23.963340+0000","last_fullsized":"2024-04-17T02:22:23.963340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T02:22:20.233009+0000","last_clean_scrub_stamp":"2024-04-17T02:22:20.233009+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:18:47.494578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65024,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705672,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":63778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":656236,"data_compressed":32512,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705672,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":654556,"data_compressed":32512,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705672,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":208896,"data_stored":65322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32512,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32512,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T02:22:35.161 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-17T02:22:35.161 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-17T02:22:35.161 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-17T02:22:35.161 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-17T02:22:35.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.301+0000 7f9d94425640 1 Processor -- start 2024-04-17T02:22:35.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.301+0000 7f9d94425640 1 -- start start 2024-04-17T02:22:35.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.301+0000 7f9d94425640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9d8c0a7f70 0x7f9d8c0a5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:35.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.302+0000 7f9d94425640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9d8c148d90 0x7f9d8c14f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:35.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.302+0000 7f9d94425640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d8c0723a0 con 0x7f9d8c13b990 2024-04-17T02:22:35.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.302+0000 7f9d94425640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f9d8c0a8350 con 0x7f9d8c148d90 2024-04-17T02:22:35.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.302+0000 7f9d94425640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f9d8c0a77f0 con 0x7f9d8c0a7f70 2024-04-17T02:22:35.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.302+0000 7f9d921c1640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9d8c0a7f70 0x7f9d8c0a5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:35.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.302+0000 7f9d921c1640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9d8c0a7f70 0x7f9d8c0a5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:53176/0 (socket says 172.21.15.17:53176) 2024-04-17T02:22:35.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.302+0000 7f9d921c1640 1 -- 172.21.15.17:0/3649802258 learned_addr learned my addr 172.21.15.17:0/3649802258 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:35.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.302+0000 7f9d929c2640 1 --2- 172.21.15.17:0/3649802258 >> v2:172.21.15.122:3300/0 conn(0x7f9d8c148d90 0x7f9d8c14f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:35.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.302+0000 7f9d921c1640 1 -- 172.21.15.17:0/3649802258 >> v2:172.21.15.122:3300/0 conn(0x7f9d8c148d90 msgr2=0x7f9d8c14f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:35.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.302+0000 7f9d921c1640 1 --2- 172.21.15.17:0/3649802258 >> v2:172.21.15.122:3300/0 conn(0x7f9d8c148d90 0x7f9d8c14f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:35.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.302+0000 7f9d921c1640 1 -- 172.21.15.17:0/3649802258 >> v1:172.21.15.122:6789/0 conn(0x7f9d8c13b990 legacy=0x7f9d8c0a6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:35.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.302+0000 7f9d921c1640 1 -- 172.21.15.17:0/3649802258 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d8c1485f0 con 0x7f9d8c0a7f70 2024-04-17T02:22:35.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.303+0000 7f9d921c1640 1 --2- 172.21.15.17:0/3649802258 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9d8c0a7f70 0x7f9d8c0a5aa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9d88009e50 tx=0x7f9d8802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cd629d10d4fc14c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:35.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.303+0000 7f9d911bf640 1 -- 172.21.15.17:0/3649802258 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8802cb00 con 0x7f9d8c0a7f70 2024-04-17T02:22:35.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.303+0000 7f9d911bf640 1 -- 172.21.15.17:0/3649802258 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d8802cca0 con 0x7f9d8c0a7f70 2024-04-17T02:22:35.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.303+0000 7f9d911bf640 1 -- 172.21.15.17:0/3649802258 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d88034610 con 0x7f9d8c0a7f70 2024-04-17T02:22:35.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.303+0000 7f9d94425640 1 -- 172.21.15.17:0/3649802258 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9d8c0a7f70 msgr2=0x7f9d8c0a5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:35.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.303+0000 7f9d94425640 1 --2- 172.21.15.17:0/3649802258 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9d8c0a7f70 0x7f9d8c0a5aa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9d88009e50 tx=0x7f9d8802bf60 comp rx=0 tx=0).stop 2024-04-17T02:22:35.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.304+0000 7f9d94425640 1 -- 172.21.15.17:0/3649802258 shutdown_connections 2024-04-17T02:22:35.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.304+0000 7f9d94425640 1 --2- 172.21.15.17:0/3649802258 >> v2:172.21.15.122:3300/0 conn(0x7f9d8c148d90 0x7f9d8c14f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:35.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.304+0000 7f9d94425640 1 --2- 172.21.15.17:0/3649802258 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9d8c0a7f70 0x7f9d8c0a5aa0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:35.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.304+0000 7f9d94425640 1 -- 172.21.15.17:0/3649802258 >> 172.21.15.17:0/3649802258 conn(0x7f9d8c0741a0 msgr2=0x7f9d8c0745b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:35.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.304+0000 7f9d94425640 1 -- 172.21.15.17:0/3649802258 shutdown_connections 2024-04-17T02:22:35.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.304+0000 7f9d94425640 1 -- 172.21.15.17:0/3649802258 wait complete. 2024-04-17T02:22:35.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.305+0000 7f9d94425640 1 Processor -- start 2024-04-17T02:22:35.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.305+0000 7f9d94425640 1 -- start start 2024-04-17T02:22:35.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.305+0000 7f9d94425640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d8c0a7f70 0x7f9d8c0a4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:35.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.305+0000 7f9d94425640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9d8c13b990 0x7f9d8c13a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:35.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.305+0000 7f9d94425640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d8c148d90 0x7f9d8c1da8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:35.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.305+0000 7f9d94425640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9d8c149240 con 0x7f9d8c0a7f70 2024-04-17T02:22:35.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.305+0000 7f9d94425640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9d8c0a7530 con 0x7f9d8c148d90 2024-04-17T02:22:35.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.305+0000 7f9d94425640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f9d8c1493c0 con 0x7f9d8c13b990 2024-04-17T02:22:35.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.305+0000 7f9d921c1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d8c0a7f70 0x7f9d8c0a4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:35.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.305+0000 7f9d919c0640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9d8c13b990 0x7f9d8c13a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:35.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.305+0000 7f9d921c1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d8c0a7f70 0x7f9d8c0a4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52576/0 (socket says 172.21.15.17:52576) 2024-04-17T02:22:35.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.305+0000 7f9d921c1640 1 -- 172.21.15.17:0/3849560396 learned_addr learned my addr 172.21.15.17:0/3849560396 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:35.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.305+0000 7f9d929c2640 1 --2- 172.21.15.17:0/3849560396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d8c148d90 0x7f9d8c1da8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:35.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.306+0000 7f9d919c0640 1 -- 172.21.15.17:0/3849560396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d8c148d90 msgr2=0x7f9d8c1da8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:35.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.306+0000 7f9d919c0640 1 --2- 172.21.15.17:0/3849560396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d8c148d90 0x7f9d8c1da8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:35.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.306+0000 7f9d919c0640 1 -- 172.21.15.17:0/3849560396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d8c0a7f70 msgr2=0x7f9d8c0a4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:35.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.306+0000 7f9d919c0640 1 --2- 172.21.15.17:0/3849560396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d8c0a7f70 0x7f9d8c0a4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:35.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.306+0000 7f9d919c0640 1 -- 172.21.15.17:0/3849560396 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d8c1dafd0 con 0x7f9d8c13b990 2024-04-17T02:22:35.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.306+0000 7f9d921c1640 1 --2- 172.21.15.17:0/3849560396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d8c0a7f70 0x7f9d8c0a4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:35.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.306+0000 7f9d919c0640 1 --2- 172.21.15.17:0/3849560396 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9d8c13b990 0x7f9d8c13a220 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c00c3c0 tx=0x7f9d7c00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:35.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.306+0000 7f9d82ffd640 1 -- 172.21.15.17:0/3849560396 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c0052d0 con 0x7f9d8c13b990 2024-04-17T02:22:35.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.306+0000 7f9d82ffd640 1 -- 172.21.15.17:0/3849560396 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d7c005490 con 0x7f9d8c13b990 2024-04-17T02:22:35.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.306+0000 7f9d94425640 1 -- 172.21.15.17:0/3849560396 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d8c1db290 con 0x7f9d8c13b990 2024-04-17T02:22:35.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.306+0000 7f9d82ffd640 1 -- 172.21.15.17:0/3849560396 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c007260 con 0x7f9d8c13b990 2024-04-17T02:22:35.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.306+0000 7f9d94425640 1 -- 172.21.15.17:0/3849560396 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d8c0a4220 con 0x7f9d8c13b990 2024-04-17T02:22:35.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.307+0000 7f9d94425640 1 -- 172.21.15.17:0/3849560396 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d8c0b8e30 con 0x7f9d8c13b990 2024-04-17T02:22:35.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.308+0000 7f9d82ffd640 1 -- 172.21.15.17:0/3849560396 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f9d7c007400 con 0x7f9d8c13b990 2024-04-17T02:22:35.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.308+0000 7f9d82ffd640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:35.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.309+0000 7f9d82ffd640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:35.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.309+0000 7f9d82ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:35.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.309+0000 7f9d82ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:35.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.309+0000 7f9d82ffd640 1 --2- 172.21.15.17:0/3849560396 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f9d7009f480 0x7f9d700a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:35.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.309+0000 7f9d921c1640 1 --2- 172.21.15.17:0/3849560396 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f9d7009f480 0x7f9d700a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:35.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.309+0000 7f9d82ffd640 1 -- 172.21.15.17:0/3849560396 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f9d7c0c8680 con 0x7f9d8c13b990 2024-04-17T02:22:35.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.309+0000 7f9d921c1640 1 --2- 172.21.15.17:0/3849560396 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f9d7009f480 0x7f9d700a1940 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9d88009e50 tx=0x7f9d88030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:35.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.313+0000 7f9d82ffd640 1 -- 172.21.15.17:0/3849560396 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f9d8c0b8e30 con 0x7f9d8c13b990 2024-04-17T02:22:35.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.531+0000 7f9d94425640 1 -- 172.21.15.17:0/3849560396 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9d8c0687f0 con 0x7f9d8c13b990 2024-04-17T02:22:35.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.531+0000 7f9d82ffd640 1 -- 172.21.15.17:0/3849560396 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f9d7c097090 con 0x7f9d8c13b990 2024-04-17T02:22:35.532 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:22:35.533 INFO:teuthology.orchestra.run.smithi017.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-17T02:22:35.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.533+0000 7f9d94425640 10 mgrc shutdown 2024-04-17T02:22:35.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.533+0000 7f9d94425640 1 -- 172.21.15.17:0/3849560396 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f9d7009f480 msgr2=0x7f9d700a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:35.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.533+0000 7f9d94425640 1 --2- 172.21.15.17:0/3849560396 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f9d7009f480 0x7f9d700a1940 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9d88009e50 tx=0x7f9d88030000 comp rx=0 tx=0).stop 2024-04-17T02:22:35.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.533+0000 7f9d94425640 1 -- 172.21.15.17:0/3849560396 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9d8c13b990 msgr2=0x7f9d8c13a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:35.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.533+0000 7f9d94425640 1 --2- 172.21.15.17:0/3849560396 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9d8c13b990 0x7f9d8c13a220 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c00c3c0 tx=0x7f9d7c00c880 comp rx=0 tx=0).stop 2024-04-17T02:22:35.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.534+0000 7f9d94425640 1 -- 172.21.15.17:0/3849560396 shutdown_connections 2024-04-17T02:22:35.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.534+0000 7f9d94425640 1 --2- 172.21.15.17:0/3849560396 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f9d7009f480 0x7f9d700a1940 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:35.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.534+0000 7f9d94425640 1 --2- 172.21.15.17:0/3849560396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d8c148d90 0x7f9d8c1da8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:35.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.534+0000 7f9d94425640 1 --2- 172.21.15.17:0/3849560396 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9d8c13b990 0x7f9d8c13a220 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:35.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.534+0000 7f9d94425640 1 --2- 172.21.15.17:0/3849560396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d8c0a7f70 0x7f9d8c0a4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:35.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.534+0000 7f9d94425640 1 -- 172.21.15.17:0/3849560396 >> 172.21.15.17:0/3849560396 conn(0x7f9d8c0741a0 msgr2=0x7f9d8c072820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:35.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.534+0000 7f9d94425640 1 -- 172.21.15.17:0/3849560396 shutdown_connections 2024-04-17T02:22:35.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.534+0000 7f9d94425640 1 -- 172.21.15.17:0/3849560396 wait complete. 2024-04-17T02:22:35.545 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-17T02:22:35.546 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T02:22:35.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.648+0000 7f513e0b3640 1 Processor -- start 2024-04-17T02:22:35.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.648+0000 7f513e0b3640 1 -- start start 2024-04-17T02:22:35.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.649+0000 7f513e0b3640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f51380a9120 0x7f51380a8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:35.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.649+0000 7f513e0b3640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f51380a8270 0x7f51380733e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:35.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.649+0000 7f513e0b3640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5138148d80 con 0x7f513806b370 2024-04-17T02:22:35.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.649+0000 7f513e0b3640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f5138149040 con 0x7f51380a9120 2024-04-17T02:22:35.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.649+0000 7f513e0b3640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f513806eb80 con 0x7f51380a8270 2024-04-17T02:22:35.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.649+0000 7f5137fff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f51380a8270 0x7f51380733e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:35.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.649+0000 7f51377fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f513806b370 0x7f5138072cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42072/0 (socket says 172.21.15.17:42072) 2024-04-17T02:22:35.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.649+0000 7f51377fe640 1 -- 172.21.15.17:0/2785144421 learned_addr learned my addr 172.21.15.17:0/2785144421 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:22:35.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.649+0000 7f5136ffd640 1 --2- 172.21.15.17:0/2785144421 >> v2:172.21.15.122:3300/0 conn(0x7f51380a9120 0x7f51380a8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:35.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.649+0000 7f51367fc640 1 -- 172.21.15.17:0/2785144421 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2535877641 0 0) 0x7f5138148d80 con 0x7f513806b370 2024-04-17T02:22:35.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.649+0000 7f51367fc640 1 -- 172.21.15.17:0/2785144421 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5120003520 con 0x7f513806b370 2024-04-17T02:22:35.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.649+0000 7f5137fff640 1 -- 172.21.15.17:0/2785144421 >> v2:172.21.15.122:3300/0 conn(0x7f51380a9120 msgr2=0x7f51380a8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:35.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.649+0000 7f5137fff640 1 --2- 172.21.15.17:0/2785144421 >> v2:172.21.15.122:3300/0 conn(0x7f51380a9120 0x7f51380a8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:35.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.649+0000 7f5137fff640 1 -- 172.21.15.17:0/2785144421 >> v1:172.21.15.17:6789/0 conn(0x7f513806b370 legacy=0x7f5138072cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:35.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.649+0000 7f5137fff640 1 -- 172.21.15.17:0/2785144421 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51380a5f70 con 0x7f51380a8270 2024-04-17T02:22:35.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.650+0000 7f5137fff640 1 --2- 172.21.15.17:0/2785144421 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f51380a8270 0x7f51380733e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f51380a6200 tx=0x7f513002be00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=953fee9a5b966ccc server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:35.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.650+0000 7f51367fc640 1 -- 172.21.15.17:0/2785144421 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5130039070 con 0x7f51380a8270 2024-04-17T02:22:35.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.650+0000 7f51367fc640 1 -- 172.21.15.17:0/2785144421 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f513002cbb0 con 0x7f51380a8270 2024-04-17T02:22:35.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.650+0000 7f51367fc640 1 -- 172.21.15.17:0/2785144421 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5130034440 con 0x7f51380a8270 2024-04-17T02:22:35.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.651+0000 7f513e0b3640 1 -- 172.21.15.17:0/2785144421 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f51380a8270 msgr2=0x7f51380733e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:35.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.651+0000 7f513e0b3640 1 --2- 172.21.15.17:0/2785144421 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f51380a8270 0x7f51380733e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f51380a6200 tx=0x7f513002be00 comp rx=0 tx=0).stop 2024-04-17T02:22:35.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.651+0000 7f513e0b3640 1 -- 172.21.15.17:0/2785144421 shutdown_connections 2024-04-17T02:22:35.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.651+0000 7f513e0b3640 1 --2- 172.21.15.17:0/2785144421 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f51380a8270 0x7f51380733e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:35.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.651+0000 7f513e0b3640 1 --2- 172.21.15.17:0/2785144421 >> v2:172.21.15.122:3300/0 conn(0x7f51380a9120 0x7f51380a8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:35.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.651+0000 7f513e0b3640 1 -- 172.21.15.17:0/2785144421 >> 172.21.15.17:0/2785144421 conn(0x7f51380a6ab0 msgr2=0x7f51380a6ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:35.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.651+0000 7f513e0b3640 1 -- 172.21.15.17:0/2785144421 shutdown_connections 2024-04-17T02:22:35.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.651+0000 7f513e0b3640 1 -- 172.21.15.17:0/2785144421 wait complete. 2024-04-17T02:22:35.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.652+0000 7f513e0b3640 1 Processor -- start 2024-04-17T02:22:35.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.652+0000 7f513e0b3640 1 -- start start 2024-04-17T02:22:35.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.652+0000 7f513e0b3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f513806b370 0x7f5138144d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:35.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.652+0000 7f513e0b3640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f51380a8270 0x7f513809edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:35.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.652+0000 7f513e0b3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51380a9120 0x7f51380b7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:35.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.652+0000 7f513e0b3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f51381489c0 con 0x7f513806b370 2024-04-17T02:22:35.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.652+0000 7f513e0b3640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5138148840 con 0x7f51380a9120 2024-04-17T02:22:35.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.652+0000 7f513e0b3640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f5138148b40 con 0x7f51380a8270 2024-04-17T02:22:35.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.652+0000 7f51377fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f513806b370 0x7f5138144d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:35.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.652+0000 7f5136ffd640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f51380a8270 0x7f513809edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:35.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.652+0000 7f51377fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f513806b370 0x7f5138144d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52584/0 (socket says 172.21.15.17:52584) 2024-04-17T02:22:35.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.652+0000 7f51377fe640 1 -- 172.21.15.17:0/1238837657 learned_addr learned my addr 172.21.15.17:0/1238837657 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:35.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.653+0000 7f5137fff640 1 --2- 172.21.15.17:0/1238837657 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51380a9120 0x7f51380b7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:35.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.653+0000 7f51377fe640 1 -- 172.21.15.17:0/1238837657 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f51380a8270 msgr2=0x7f513809edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:35.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.653+0000 7f51377fe640 1 --2- 172.21.15.17:0/1238837657 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f51380a8270 0x7f513809edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:35.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.653+0000 7f51377fe640 1 -- 172.21.15.17:0/1238837657 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51380a9120 msgr2=0x7f51380b7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:35.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.653+0000 7f51377fe640 1 --2- 172.21.15.17:0/1238837657 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51380a9120 0x7f51380b7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:35.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.653+0000 7f51377fe640 1 -- 172.21.15.17:0/1238837657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5138147e20 con 0x7f513806b370 2024-04-17T02:22:35.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.653+0000 7f5137fff640 1 --2- 172.21.15.17:0/1238837657 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51380a9120 0x7f51380b7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T02:22:35.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.653+0000 7f5136ffd640 1 --2- 172.21.15.17:0/1238837657 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f51380a8270 0x7f513809edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:35.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.653+0000 7f51377fe640 1 --2- 172.21.15.17:0/1238837657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f513806b370 0x7f5138144d50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f512800c460 tx=0x7f512800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:35.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.653+0000 7f511ffff640 1 -- 172.21.15.17:0/1238837657 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5128017070 con 0x7f513806b370 2024-04-17T02:22:35.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.653+0000 7f511ffff640 1 -- 172.21.15.17:0/1238837657 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5128005ce0 con 0x7f513806b370 2024-04-17T02:22:35.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.653+0000 7f513e0b3640 1 -- 172.21.15.17:0/1238837657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f513809f300 con 0x7f513806b370 2024-04-17T02:22:35.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.653+0000 7f511ffff640 1 -- 172.21.15.17:0/1238837657 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5128007290 con 0x7f513806b370 2024-04-17T02:22:35.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.653+0000 7f513e0b3640 1 -- 172.21.15.17:0/1238837657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51381de1c0 con 0x7f513806b370 2024-04-17T02:22:35.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.654+0000 7f513e0b3640 1 -- 172.21.15.17:0/1238837657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51380a3ee0 con 0x7f513806b370 2024-04-17T02:22:35.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.655+0000 7f511ffff640 1 -- 172.21.15.17:0/1238837657 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f512801a070 con 0x7f513806b370 2024-04-17T02:22:35.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.655+0000 7f511ffff640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:35.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.656+0000 7f511ffff640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:35.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.656+0000 7f511ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:35.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.656+0000 7f511ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:35.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.656+0000 7f511ffff640 1 --2- 172.21.15.17:0/1238837657 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f512409f480 0x7f51240a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:35.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.656+0000 7f5136ffd640 1 --2- 172.21.15.17:0/1238837657 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f512409f480 0x7f51240a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:35.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.656+0000 7f511ffff640 1 -- 172.21.15.17:0/1238837657 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f51280c87c0 con 0x7f513806b370 2024-04-17T02:22:35.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.656+0000 7f5136ffd640 1 --2- 172.21.15.17:0/1238837657 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f512409f480 0x7f51240a1940 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f513813b500 tx=0x7f512c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:35.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.660+0000 7f511ffff640 1 -- 172.21.15.17:0/1238837657 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f51380a3ee0 con 0x7f513806b370 2024-04-17T02:22:35.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.843+0000 7f513e0b3640 1 -- 172.21.15.17:0/1238837657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f51380687f0 con 0x7f513806b370 2024-04-17T02:22:35.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.844+0000 7f511ffff640 1 -- 172.21.15.17:0/1238837657 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+13561 (secure 0 0 0) 0x7f51280b3510 con 0x7f513806b370 2024-04-17T02:22:35.845 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:22:35.845 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":20,"fsid":"7cbfae20-b10d-41da-92b7-cbd5c1632e23","created":"2024-04-17T02:22:00.246446+0000","modified":"2024-04-17T02:22:23.241120+0000","last_up_change":"2024-04-17T02:22:09.077928+0000","last_in_change":"2024-04-17T02:22:01.415384+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T02:22:10.533377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-17T02:22:15.947495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-17T02:22:20.016616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-17T02:22:20.573938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2973665c-6c5e-4688-bffe-72d3bdcf467f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6801","nonce":1828284343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6803","nonce":1828284343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6807","nonce":1828284343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6805","nonce":1828284343}]},"public_addr":"172.21.15.17:6801/1828284343","cluster_addr":"172.21.15.17:6803/1828284343","heartbeat_back_addr":"172.21.15.17:6807/1828284343","heartbeat_front_addr":"172.21.15.17:6805/1828284343","state":["exists","up"]},{"osd":1,"uuid":"a59a034d-19b4-47e8-8ca5-538597b4af1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6809","nonce":2064593011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6811","nonce":2064593011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6815","nonce":2064593011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6813","nonce":2064593011}]},"public_addr":"172.21.15.122:6809/2064593011","cluster_addr":"172.21.15.122:6811/2064593011","heartbeat_back_addr":"172.21.15.122:6815/2064593011","heartbeat_front_addr":"172.21.15.122:6813/2064593011","state":["exists","up"]},{"osd":2,"uuid":"070f4c5f-459f-46ff-b980-05b1ac50c951","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6817","nonce":929092547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6819","nonce":929092547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6823","nonce":929092547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6821","nonce":929092547}]},"public_addr":"172.21.15.122:6817/929092547","cluster_addr":"172.21.15.122:6819/929092547","heartbeat_back_addr":"172.21.15.122:6823/929092547","heartbeat_front_addr":"172.21.15.122:6821/929092547","state":["exists","up"]},{"osd":3,"uuid":"96216a49-a7b6-40eb-bc93-cc8c78a5270a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6801","nonce":204132523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6803","nonce":204132523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6807","nonce":204132523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6805","nonce":204132523}]},"public_addr":"172.21.15.122:6801/204132523","cluster_addr":"172.21.15.122:6803/204132523","heartbeat_back_addr":"172.21.15.122:6807/204132523","heartbeat_front_addr":"172.21.15.122:6805/204132523","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.477173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.522791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.590625+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.480698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T02:22:35.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.846+0000 7f513e0b3640 10 mgrc shutdown 2024-04-17T02:22:35.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.846+0000 7f513e0b3640 1 -- 172.21.15.17:0/1238837657 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f512409f480 msgr2=0x7f51240a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:35.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.846+0000 7f513e0b3640 1 --2- 172.21.15.17:0/1238837657 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f512409f480 0x7f51240a1940 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f513813b500 tx=0x7f512c009190 comp rx=0 tx=0).stop 2024-04-17T02:22:35.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.846+0000 7f513e0b3640 1 -- 172.21.15.17:0/1238837657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f513806b370 msgr2=0x7f5138144d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:35.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.846+0000 7f513e0b3640 1 --2- 172.21.15.17:0/1238837657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f513806b370 0x7f5138144d50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f512800c460 tx=0x7f512800c920 comp rx=0 tx=0).stop 2024-04-17T02:22:35.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.846+0000 7f513e0b3640 1 -- 172.21.15.17:0/1238837657 shutdown_connections 2024-04-17T02:22:35.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.846+0000 7f513e0b3640 1 --2- 172.21.15.17:0/1238837657 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f512409f480 0x7f51240a1940 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:35.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.846+0000 7f513e0b3640 1 --2- 172.21.15.17:0/1238837657 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51380a9120 0x7f51380b7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:35.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.846+0000 7f513e0b3640 1 --2- 172.21.15.17:0/1238837657 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f51380a8270 0x7f513809edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:35.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.846+0000 7f513e0b3640 1 --2- 172.21.15.17:0/1238837657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f513806b370 0x7f5138144d50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:35.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.846+0000 7f513e0b3640 1 -- 172.21.15.17:0/1238837657 >> 172.21.15.17:0/1238837657 conn(0x7f51380a6ab0 msgr2=0x7f51381414c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:35.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.846+0000 7f513e0b3640 1 -- 172.21.15.17:0/1238837657 shutdown_connections 2024-04-17T02:22:35.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.846+0000 7f513e0b3640 1 -- 172.21.15.17:0/1238837657 wait complete. 2024-04-17T02:22:35.858 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T02:22:10.533377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-17T02:22:15.947495+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T02:22:20.016616+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T02:22:20.573938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.190000057220459, 'score_stable': 1.190000057220459, 'optimal_score': 1, 'raw_score_acting': 1.190000057220459, 'raw_score_stable': 1.190000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-17T02:22:35.859 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T02:22:35.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.964+0000 7fddd66c8640 1 Processor -- start 2024-04-17T02:22:35.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.965+0000 7fddd66c8640 1 -- start start 2024-04-17T02:22:35.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.965+0000 7fddd66c8640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fddd00a5f30 0x7fddd00a82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:35.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.965+0000 7fddd66c8640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fddd00733d0 0x7fddd0143560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:35.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.965+0000 7fddd66c8640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fddd0143aa0 0x7fddd006e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:35.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.965+0000 7fddd66c8640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fddd0143ee0 con 0x7fddd00733d0 2024-04-17T02:22:35.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.965+0000 7fddd66c8640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fddd00a8f30 con 0x7fddd00a5f30 2024-04-17T02:22:35.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.965+0000 7fddd66c8640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fddd00a7360 con 0x7fddd0143aa0 2024-04-17T02:22:35.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.965+0000 7fddc7fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fddd00733d0 0x7fddd0143560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:35.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.965+0000 7fddd4c65640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fddd0143aa0 0x7fddd006e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:35.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.965+0000 7fddc7fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fddd00733d0 0x7fddd0143560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52594/0 (socket says 172.21.15.17:52594) 2024-04-17T02:22:35.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.965+0000 7fddc7fff640 1 -- 172.21.15.17:0/4023146216 learned_addr learned my addr 172.21.15.17:0/4023146216 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:35.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.966+0000 7fddcffff640 1 --2- 172.21.15.17:0/4023146216 >> v2:172.21.15.122:3300/0 conn(0x7fddd00a5f30 0x7fddd00a82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:35.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.966+0000 7fddd4c65640 1 -- 172.21.15.17:0/4023146216 >> v2:172.21.15.122:3300/0 conn(0x7fddd00a5f30 msgr2=0x7fddd00a82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:35.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.966+0000 7fddd4c65640 1 --2- 172.21.15.17:0/4023146216 >> v2:172.21.15.122:3300/0 conn(0x7fddd00a5f30 0x7fddd00a82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:35.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.966+0000 7fddd4c65640 1 -- 172.21.15.17:0/4023146216 >> v2:172.21.15.17:3300/0 conn(0x7fddd00733d0 msgr2=0x7fddd0143560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:35.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.966+0000 7fddd4c65640 1 --2- 172.21.15.17:0/4023146216 >> v2:172.21.15.17:3300/0 conn(0x7fddd00733d0 0x7fddd0143560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:35.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.966+0000 7fddd4c65640 1 -- 172.21.15.17:0/4023146216 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd00a7620 con 0x7fddd0143aa0 2024-04-17T02:22:35.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.966+0000 7fddc7fff640 1 --2- 172.21.15.17:0/4023146216 >> v2:172.21.15.17:3300/0 conn(0x7fddd00733d0 0x7fddd0143560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:35.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.966+0000 7fddd4c65640 1 --2- 172.21.15.17:0/4023146216 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fddd0143aa0 0x7fddd006e420 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fddd00a5680 tx=0x7fddc802bd90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ce30129a3384a6e server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:35.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.967+0000 7fddcf7fe640 1 -- 172.21.15.17:0/4023146216 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc8039070 con 0x7fddd0143aa0 2024-04-17T02:22:35.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.967+0000 7fddcf7fe640 1 -- 172.21.15.17:0/4023146216 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddc802cb40 con 0x7fddd0143aa0 2024-04-17T02:22:35.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.967+0000 7fddcf7fe640 1 -- 172.21.15.17:0/4023146216 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc8034440 con 0x7fddd0143aa0 2024-04-17T02:22:35.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.967+0000 7fddd66c8640 1 -- 172.21.15.17:0/4023146216 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fddd0143aa0 msgr2=0x7fddd006e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:35.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.967+0000 7fddd66c8640 1 --2- 172.21.15.17:0/4023146216 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fddd0143aa0 0x7fddd006e420 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fddd00a5680 tx=0x7fddc802bd90 comp rx=0 tx=0).stop 2024-04-17T02:22:35.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.967+0000 7fddd66c8640 1 -- 172.21.15.17:0/4023146216 shutdown_connections 2024-04-17T02:22:35.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.967+0000 7fddd66c8640 1 --2- 172.21.15.17:0/4023146216 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fddd0143aa0 0x7fddd006e420 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:35.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.967+0000 7fddd66c8640 1 --2- 172.21.15.17:0/4023146216 >> v2:172.21.15.17:3300/0 conn(0x7fddd00733d0 0x7fddd0143560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:35.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.967+0000 7fddd66c8640 1 --2- 172.21.15.17:0/4023146216 >> v2:172.21.15.122:3300/0 conn(0x7fddd00a5f30 0x7fddd00a82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:35.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.967+0000 7fddd66c8640 1 -- 172.21.15.17:0/4023146216 >> 172.21.15.17:0/4023146216 conn(0x7fddd00746d0 msgr2=0x7fddd00a7ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:35.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.967+0000 7fddd66c8640 1 -- 172.21.15.17:0/4023146216 shutdown_connections 2024-04-17T02:22:35.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.967+0000 7fddd66c8640 1 -- 172.21.15.17:0/4023146216 wait complete. 2024-04-17T02:22:35.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.968+0000 7fddd66c8640 1 Processor -- start 2024-04-17T02:22:35.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.968+0000 7fddd66c8640 1 -- start start 2024-04-17T02:22:35.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.969+0000 7fddd66c8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddd00733d0 0x7fddd009af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:35.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.969+0000 7fddd66c8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fddd00a5f30 0x7fddd0099a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:35.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.969+0000 7fddd66c8640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fddd0143aa0 0x7fddd01de000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:35.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.969+0000 7fddd66c8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fddd00a6310 con 0x7fddd00733d0 2024-04-17T02:22:35.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.969+0000 7fddd66c8640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fddd00a7140 con 0x7fddd00a5f30 2024-04-17T02:22:35.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.969+0000 7fddd66c8640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fddd00a6490 con 0x7fddd0143aa0 2024-04-17T02:22:35.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.969+0000 7fddcffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddd00733d0 0x7fddd009af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:35.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.969+0000 7fddcffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddd00733d0 0x7fddd009af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52610/0 (socket says 172.21.15.17:52610) 2024-04-17T02:22:35.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.969+0000 7fddd4c65640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fddd0143aa0 0x7fddd01de000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:35.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.969+0000 7fddcffff640 1 -- 172.21.15.17:0/3246120769 learned_addr learned my addr 172.21.15.17:0/3246120769 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:35.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.969+0000 7fddc7fff640 1 --2- 172.21.15.17:0/3246120769 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fddd00a5f30 0x7fddd0099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:35.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.969+0000 7fddd4c65640 1 -- 172.21.15.17:0/3246120769 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fddd00a5f30 msgr2=0x7fddd0099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:35.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.969+0000 7fddd4c65640 1 --2- 172.21.15.17:0/3246120769 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fddd00a5f30 0x7fddd0099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:35.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.969+0000 7fddd4c65640 1 -- 172.21.15.17:0/3246120769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddd00733d0 msgr2=0x7fddd009af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:35.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.969+0000 7fddd4c65640 1 --2- 172.21.15.17:0/3246120769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddd00733d0 0x7fddd009af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:35.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.969+0000 7fddd4c65640 1 -- 172.21.15.17:0/3246120769 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd006d060 con 0x7fddd0143aa0 2024-04-17T02:22:35.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.969+0000 7fddcffff640 1 --2- 172.21.15.17:0/3246120769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddd00733d0 0x7fddd009af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:35.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.969+0000 7fddd4c65640 1 --2- 172.21.15.17:0/3246120769 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fddd0143aa0 0x7fddd01de000 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fddd00a74e0 tx=0x7fddc8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:35.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.969+0000 7fddcd7fa640 1 -- 172.21.15.17:0/3246120769 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc8039050 con 0x7fddd0143aa0 2024-04-17T02:22:35.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.970+0000 7fddcd7fa640 1 -- 172.21.15.17:0/3246120769 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddc8045070 con 0x7fddd0143aa0 2024-04-17T02:22:35.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.970+0000 7fddcd7fa640 1 -- 172.21.15.17:0/3246120769 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc8009450 con 0x7fddd0143aa0 2024-04-17T02:22:35.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.970+0000 7fddd66c8640 1 -- 172.21.15.17:0/3246120769 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddd009a520 con 0x7fddd0143aa0 2024-04-17T02:22:35.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.970+0000 7fddd66c8640 1 -- 172.21.15.17:0/3246120769 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fddd006c210 con 0x7fddd0143aa0 2024-04-17T02:22:35.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.970+0000 7fddd66c8640 1 -- 172.21.15.17:0/3246120769 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddd00687f0 con 0x7fddd0143aa0 2024-04-17T02:22:35.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.972+0000 7fddcd7fa640 1 -- 172.21.15.17:0/3246120769 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7fddc803e850 con 0x7fddd0143aa0 2024-04-17T02:22:35.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.972+0000 7fddcd7fa640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:35.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.972+0000 7fddcd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:35.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.972+0000 7fddcd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:35.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.972+0000 7fddcd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:35.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.972+0000 7fddcd7fa640 1 --2- 172.21.15.17:0/3246120769 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fddb009f480 0x7fddb00a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:35.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.972+0000 7fddcffff640 1 --2- 172.21.15.17:0/3246120769 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fddb009f480 0x7fddb00a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:35.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.972+0000 7fddcd7fa640 1 -- 172.21.15.17:0/3246120769 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7fddc80ec210 con 0x7fddd0143aa0 2024-04-17T02:22:35.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.973+0000 7fddcffff640 1 --2- 172.21.15.17:0/3246120769 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fddb009f480 0x7fddb00a1940 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fddc0006fd0 tx=0x7fddc0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:35.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:35.976+0000 7fddcd7fa640 1 -- 172.21.15.17:0/3246120769 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fddc80bb390 con 0x7fddd0143aa0 2024-04-17T02:22:36.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.157+0000 7fddd66c8640 1 -- 172.21.15.17:0/3246120769 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fddd00682c0 con 0x7fddd0143aa0 2024-04-17T02:22:36.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.158+0000 7fddcd7fa640 1 -- 172.21.15.17:0/3246120769 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fddc80bac90 con 0x7fddd0143aa0 2024-04-17T02:22:36.159 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-04-17T02:22:36.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.160+0000 7fddd66c8640 10 mgrc shutdown 2024-04-17T02:22:36.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.160+0000 7fddd66c8640 1 -- 172.21.15.17:0/3246120769 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fddb009f480 msgr2=0x7fddb00a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:36.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.160+0000 7fddd66c8640 1 --2- 172.21.15.17:0/3246120769 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fddb009f480 0x7fddb00a1940 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fddc0006fd0 tx=0x7fddc0008040 comp rx=0 tx=0).stop 2024-04-17T02:22:36.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.160+0000 7fddd66c8640 1 -- 172.21.15.17:0/3246120769 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fddd0143aa0 msgr2=0x7fddd01de000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:36.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.160+0000 7fddd66c8640 1 --2- 172.21.15.17:0/3246120769 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fddd0143aa0 0x7fddd01de000 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fddd00a74e0 tx=0x7fddc8004a40 comp rx=0 tx=0).stop 2024-04-17T02:22:36.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.160+0000 7fddd66c8640 1 -- 172.21.15.17:0/3246120769 shutdown_connections 2024-04-17T02:22:36.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.160+0000 7fddd66c8640 1 --2- 172.21.15.17:0/3246120769 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fddb009f480 0x7fddb00a1940 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:36.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.160+0000 7fddd66c8640 1 --2- 172.21.15.17:0/3246120769 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fddd0143aa0 0x7fddd01de000 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:36.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.160+0000 7fddd66c8640 1 --2- 172.21.15.17:0/3246120769 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fddd00a5f30 0x7fddd0099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:36.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.160+0000 7fddd66c8640 1 --2- 172.21.15.17:0/3246120769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddd00733d0 0x7fddd009af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:36.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.160+0000 7fddd66c8640 1 -- 172.21.15.17:0/3246120769 >> 172.21.15.17:0/3246120769 conn(0x7fddd00746d0 msgr2=0x7fddd0141810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:36.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.160+0000 7fddd66c8640 1 -- 172.21.15.17:0/3246120769 shutdown_connections 2024-04-17T02:22:36.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.160+0000 7fddd66c8640 1 -- 172.21.15.17:0/3246120769 wait complete. 2024-04-17T02:22:36.172 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-17T02:22:36.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.278+0000 7f4c9aa47640 1 Processor -- start 2024-04-17T02:22:36.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.278+0000 7f4c9aa47640 1 -- start start 2024-04-17T02:22:36.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.279+0000 7f4c9aa47640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4c940ab3b0 0x7f4c940ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:36.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.279+0000 7f4c9aa47640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4c940acce0 0x7f4c9414f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:36.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.279+0000 7f4c9aa47640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c940a7f00 con 0x7f4c940a9560 2024-04-17T02:22:36.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.279+0000 7f4c9aa47640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f4c940abd20 con 0x7f4c940ab3b0 2024-04-17T02:22:36.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.279+0000 7f4c9aa47640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f4c940ac000 con 0x7f4c940acce0 2024-04-17T02:22:36.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.279+0000 7f4c93fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4c940ab3b0 0x7f4c940ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:36.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.279+0000 7f4c93fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4c940ab3b0 0x7f4c940ac7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52622/0 (socket says 172.21.15.17:52622) 2024-04-17T02:22:36.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.279+0000 7f4c93fff640 1 -- 172.21.15.17:0/1966904058 learned_addr learned my addr 172.21.15.17:0/1966904058 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:36.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.279+0000 7f4c93fff640 1 -- 172.21.15.17:0/1966904058 >> v2:172.21.15.122:3300/0 conn(0x7f4c940acce0 msgr2=0x7f4c9414f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:36.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.279+0000 7f4c98fe4640 1 --2- 172.21.15.17:0/1966904058 >> v2:172.21.15.122:3300/0 conn(0x7f4c940acce0 0x7f4c9414f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:36.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.279+0000 7f4c93fff640 1 --2- 172.21.15.17:0/1966904058 >> v2:172.21.15.122:3300/0 conn(0x7f4c940acce0 0x7f4c9414f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:36.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.279+0000 7f4c93fff640 1 -- 172.21.15.17:0/1966904058 >> v1:172.21.15.122:6789/0 conn(0x7f4c940a9560 legacy=0x7f4c94145730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:36.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.279+0000 7f4c93fff640 1 -- 172.21.15.17:0/1966904058 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c940a7960 con 0x7f4c940ab3b0 2024-04-17T02:22:36.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.280+0000 7f4c93fff640 1 --2- 172.21.15.17:0/1966904058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c940ab3b0 0x7f4c940ac7a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4c84009870 tx=0x7f4c8402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed22af854bff360 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:36.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.280+0000 7f4c937fe640 1 -- 172.21.15.17:0/1966904058 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8402e070 con 0x7f4c940ab3b0 2024-04-17T02:22:36.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.280+0000 7f4c937fe640 1 -- 172.21.15.17:0/1966904058 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c84037070 con 0x7f4c940ab3b0 2024-04-17T02:22:36.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.280+0000 7f4c937fe640 1 -- 172.21.15.17:0/1966904058 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c84031a00 con 0x7f4c940ab3b0 2024-04-17T02:22:36.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.281+0000 7f4c9aa47640 1 -- 172.21.15.17:0/1966904058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c940ab3b0 msgr2=0x7f4c940ac7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:36.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.281+0000 7f4c9aa47640 1 --2- 172.21.15.17:0/1966904058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c940ab3b0 0x7f4c940ac7a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4c84009870 tx=0x7f4c8402b880 comp rx=0 tx=0).stop 2024-04-17T02:22:36.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.281+0000 7f4c9aa47640 1 -- 172.21.15.17:0/1966904058 shutdown_connections 2024-04-17T02:22:36.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.281+0000 7f4c9aa47640 1 --2- 172.21.15.17:0/1966904058 >> v2:172.21.15.122:3300/0 conn(0x7f4c940acce0 0x7f4c9414f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:36.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.281+0000 7f4c9aa47640 1 --2- 172.21.15.17:0/1966904058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c940ab3b0 0x7f4c940ac7a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:36.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.281+0000 7f4c9aa47640 1 -- 172.21.15.17:0/1966904058 >> 172.21.15.17:0/1966904058 conn(0x7f4c940a9b60 msgr2=0x7f4c940a9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:36.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.281+0000 7f4c9aa47640 1 -- 172.21.15.17:0/1966904058 shutdown_connections 2024-04-17T02:22:36.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.281+0000 7f4c9aa47640 1 -- 172.21.15.17:0/1966904058 wait complete. 2024-04-17T02:22:36.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.282+0000 7f4c9aa47640 1 Processor -- start 2024-04-17T02:22:36.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.282+0000 7f4c9aa47640 1 -- start start 2024-04-17T02:22:36.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.283+0000 7f4c9aa47640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f4c940a9560 0x7f4c940ae3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:36.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.283+0000 7f4c9aa47640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c940ab3b0 0x7f4c9413b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:36.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.283+0000 7f4c9aa47640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c940acce0 0x7f4c9413bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:36.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.283+0000 7f4c9aa47640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4c9406b5b0 con 0x7f4c940ab3b0 2024-04-17T02:22:36.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.283+0000 7f4c9aa47640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4c94145e40 con 0x7f4c940acce0 2024-04-17T02:22:36.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.283+0000 7f4c9aa47640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f4c9413ff20 con 0x7f4c940a9560 2024-04-17T02:22:36.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.283+0000 7f4c93fff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f4c940a9560 0x7f4c940ae3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:36.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.283+0000 7f4c8bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c940ab3b0 0x7f4c9413b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:36.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.283+0000 7f4c8bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c940ab3b0 0x7f4c9413b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52626/0 (socket says 172.21.15.17:52626) 2024-04-17T02:22:36.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.283+0000 7f4c8bfff640 1 -- 172.21.15.17:0/440217741 learned_addr learned my addr 172.21.15.17:0/440217741 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:36.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.283+0000 7f4c93fff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f4c940a9560 0x7f4c940ae3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:53228/0 (socket says 172.21.15.17:53228) 2024-04-17T02:22:36.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.283+0000 7f4c98fe4640 1 --2- 172.21.15.17:0/440217741 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c940acce0 0x7f4c9413bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:36.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.283+0000 7f4c8bfff640 1 -- 172.21.15.17:0/440217741 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f4c940a9560 msgr2=0x7f4c940ae3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:36.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.283+0000 7f4c8bfff640 1 --2- 172.21.15.17:0/440217741 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f4c940a9560 0x7f4c940ae3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:36.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.283+0000 7f4c8bfff640 1 -- 172.21.15.17:0/440217741 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c940acce0 msgr2=0x7f4c9413bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:36.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.283+0000 7f4c8bfff640 1 --2- 172.21.15.17:0/440217741 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c940acce0 0x7f4c9413bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:36.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.283+0000 7f4c8bfff640 1 -- 172.21.15.17:0/440217741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c9413c3f0 con 0x7f4c940ab3b0 2024-04-17T02:22:36.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.283+0000 7f4c93fff640 1 --2- 172.21.15.17:0/440217741 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f4c940a9560 0x7f4c940ae3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:36.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.283+0000 7f4c8bfff640 1 --2- 172.21.15.17:0/440217741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c940ab3b0 0x7f4c9413b760 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c00c430 tx=0x7f4c7c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:36.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.283+0000 7f4c917fa640 1 -- 172.21.15.17:0/440217741 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c011790 con 0x7f4c940ab3b0 2024-04-17T02:22:36.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.283+0000 7f4c917fa640 1 -- 172.21.15.17:0/440217741 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c7c017070 con 0x7f4c940ab3b0 2024-04-17T02:22:36.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.283+0000 7f4c9aa47640 1 -- 172.21.15.17:0/440217741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c9406bd70 con 0x7f4c940ab3b0 2024-04-17T02:22:36.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.283+0000 7f4c917fa640 1 -- 172.21.15.17:0/440217741 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c011b70 con 0x7f4c940ab3b0 2024-04-17T02:22:36.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.284+0000 7f4c9aa47640 1 -- 172.21.15.17:0/440217741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c9413f670 con 0x7f4c940ab3b0 2024-04-17T02:22:36.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.285+0000 7f4c9aa47640 1 -- 172.21.15.17:0/440217741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c940687f0 con 0x7f4c940ab3b0 2024-04-17T02:22:36.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.286+0000 7f4c917fa640 1 -- 172.21.15.17:0/440217741 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f4c7c011d10 con 0x7f4c940ab3b0 2024-04-17T02:22:36.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.286+0000 7f4c917fa640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:36.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.286+0000 7f4c917fa640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:36.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.286+0000 7f4c917fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:36.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.286+0000 7f4c917fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:36.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.286+0000 7f4c917fa640 1 --2- 172.21.15.17:0/440217741 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f4c7409f480 0x7f4c740a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:36.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.286+0000 7f4c93fff640 1 --2- 172.21.15.17:0/440217741 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f4c7409f480 0x7f4c740a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:36.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.286+0000 7f4c917fa640 1 -- 172.21.15.17:0/440217741 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f4c7c0c9370 con 0x7f4c940ab3b0 2024-04-17T02:22:36.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.287+0000 7f4c93fff640 1 --2- 172.21.15.17:0/440217741 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f4c7409f480 0x7f4c740a1940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4c84036000 tx=0x7f4c8403d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:36.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.290+0000 7f4c917fa640 1 -- 172.21.15.17:0/440217741 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4c7c0983d0 con 0x7f4c940ab3b0 2024-04-17T02:22:36.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.470+0000 7f4c9aa47640 1 -- 172.21.15.17:0/440217741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) -- 0x7f4c9406c250 con 0x7f4c940ab3b0 2024-04-17T02:22:36.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.471+0000 7f4c917fa640 1 -- 172.21.15.17:0/440217741 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) ==== 92+0+10 (secure 0 0 0) 0x7f4c7c097cd0 con 0x7f4c940ab3b0 2024-04-17T02:22:36.472 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2024-04-17T02:22:36.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.473+0000 7f4c9aa47640 10 mgrc shutdown 2024-04-17T02:22:36.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.473+0000 7f4c9aa47640 1 -- 172.21.15.17:0/440217741 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f4c7409f480 msgr2=0x7f4c740a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:36.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.473+0000 7f4c9aa47640 1 --2- 172.21.15.17:0/440217741 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f4c7409f480 0x7f4c740a1940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4c84036000 tx=0x7f4c8403d040 comp rx=0 tx=0).stop 2024-04-17T02:22:36.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.473+0000 7f4c9aa47640 1 -- 172.21.15.17:0/440217741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c940ab3b0 msgr2=0x7f4c9413b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:36.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.473+0000 7f4c9aa47640 1 --2- 172.21.15.17:0/440217741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c940ab3b0 0x7f4c9413b760 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c00c430 tx=0x7f4c7c00c8f0 comp rx=0 tx=0).stop 2024-04-17T02:22:36.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.473+0000 7f4c9aa47640 1 -- 172.21.15.17:0/440217741 shutdown_connections 2024-04-17T02:22:36.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.473+0000 7f4c9aa47640 1 --2- 172.21.15.17:0/440217741 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f4c7409f480 0x7f4c740a1940 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:36.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.473+0000 7f4c9aa47640 1 --2- 172.21.15.17:0/440217741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c940ab3b0 0x7f4c9413b760 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:36.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.473+0000 7f4c9aa47640 1 --2- 172.21.15.17:0/440217741 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c940acce0 0x7f4c9413bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:36.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.473+0000 7f4c9aa47640 1 --2- 172.21.15.17:0/440217741 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f4c940a9560 0x7f4c940ae3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:36.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.473+0000 7f4c9aa47640 1 -- 172.21.15.17:0/440217741 >> 172.21.15.17:0/440217741 conn(0x7f4c940a9b60 msgr2=0x7f4c940b9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:36.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.473+0000 7f4c9aa47640 1 -- 172.21.15.17:0/440217741 shutdown_connections 2024-04-17T02:22:36.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.473+0000 7f4c9aa47640 1 -- 172.21.15.17:0/440217741 wait complete. 2024-04-17T02:22:36.485 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T02:22:36.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.591+0000 7eff06c38640 1 Processor -- start 2024-04-17T02:22:36.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.591+0000 7eff06c38640 1 -- start start 2024-04-17T02:22:36.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.591+0000 7eff06c38640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7eff000a9c00 0x7eff000aa090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:36.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.591+0000 7eff06c38640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff00148870 con 0x7eff0013b540 2024-04-17T02:22:36.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.591+0000 7eff06c38640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff0013bc90 con 0x7eff000b8e30 2024-04-17T02:22:36.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.591+0000 7eff06c38640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7eff000b9210 con 0x7eff000a9c00 2024-04-17T02:22:36.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.592+0000 7eff051d5640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7eff000a9c00 0x7eff000aa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:36.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.592+0000 7efefffff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7eff0013b540 0x7eff00148f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42076/0 (socket says 172.21.15.17:42076) 2024-04-17T02:22:36.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.592+0000 7efefffff640 1 -- 172.21.15.17:0/700080901 learned_addr learned my addr 172.21.15.17:0/700080901 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:22:36.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.592+0000 7eff051d5640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7eff000a9c00 0x7eff000aa090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52642/0 (socket says 172.21.15.17:52642) 2024-04-17T02:22:36.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.592+0000 7eff051d5640 1 -- 172.21.15.17:0/700080901 >> v1:172.21.15.122:6789/0 conn(0x7eff000b8e30 legacy=0x7eff000aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:36.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.592+0000 7eff051d5640 1 -- 172.21.15.17:0/700080901 >> v1:172.21.15.17:6789/0 conn(0x7eff0013b540 legacy=0x7eff00148f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:36.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.592+0000 7efeff7fe640 1 -- 172.21.15.17:0/700080901 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1806684009 0 0) 0x7eff00148870 con 0x7eff0013b540 2024-04-17T02:22:36.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.592+0000 7eff051d5640 1 -- 172.21.15.17:0/700080901 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff00152a50 con 0x7eff000a9c00 2024-04-17T02:22:36.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.593+0000 7eff051d5640 1 --2- 172.21.15.17:0/700080901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff000a9c00 0x7eff000aa090 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7efef80097a0 tx=0x7efef802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8c8125c0b3dd172 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:36.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.593+0000 7efeff7fe640 1 -- 172.21.15.17:0/700080901 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef8035020 con 0x7eff000a9c00 2024-04-17T02:22:36.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.593+0000 7efeff7fe640 1 -- 172.21.15.17:0/700080901 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efef8031830 con 0x7eff000a9c00 2024-04-17T02:22:36.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.593+0000 7efeff7fe640 1 -- 172.21.15.17:0/700080901 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef8031c00 con 0x7eff000a9c00 2024-04-17T02:22:36.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.593+0000 7eff06c38640 1 -- 172.21.15.17:0/700080901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff000a9c00 msgr2=0x7eff000aa090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:36.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.593+0000 7eff06c38640 1 --2- 172.21.15.17:0/700080901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff000a9c00 0x7eff000aa090 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7efef80097a0 tx=0x7efef802b8d0 comp rx=0 tx=0).stop 2024-04-17T02:22:36.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.593+0000 7eff06c38640 1 -- 172.21.15.17:0/700080901 shutdown_connections 2024-04-17T02:22:36.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.593+0000 7eff06c38640 1 --2- 172.21.15.17:0/700080901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff000a9c00 0x7eff000aa090 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:36.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.593+0000 7eff06c38640 1 -- 172.21.15.17:0/700080901 >> 172.21.15.17:0/700080901 conn(0x7eff000741a0 msgr2=0x7eff000745b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:36.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.593+0000 7eff06c38640 1 -- 172.21.15.17:0/700080901 shutdown_connections 2024-04-17T02:22:36.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.593+0000 7eff06c38640 1 -- 172.21.15.17:0/700080901 wait complete. 2024-04-17T02:22:36.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.594+0000 7eff06c38640 1 Processor -- start 2024-04-17T02:22:36.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.594+0000 7eff06c38640 1 -- start start 2024-04-17T02:22:36.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.595+0000 7eff06c38640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7eff000a9c00 0x7eff000b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:36.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.595+0000 7eff06c38640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff000b8e30 0x7eff00132560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:36.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.595+0000 7eff06c38640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff0013b540 0x7eff00132aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:36.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.595+0000 7eff06c38640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7eff00150c40 con 0x7eff000b8e30 2024-04-17T02:22:36.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.595+0000 7eff06c38640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7eff00149660 con 0x7eff0013b540 2024-04-17T02:22:36.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.595+0000 7eff06c38640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7eff00150dc0 con 0x7eff000a9c00 2024-04-17T02:22:36.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.595+0000 7efefffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff000b8e30 0x7eff00132560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:36.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.595+0000 7eff049d4640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7eff000a9c00 0x7eff000b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:36.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.595+0000 7efefffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff000b8e30 0x7eff00132560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52646/0 (socket says 172.21.15.17:52646) 2024-04-17T02:22:36.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.595+0000 7efefffff640 1 -- 172.21.15.17:0/2639391035 learned_addr learned my addr 172.21.15.17:0/2639391035 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:36.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.595+0000 7eff051d5640 1 --2- 172.21.15.17:0/2639391035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff0013b540 0x7eff00132aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:36.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.595+0000 7efefffff640 1 -- 172.21.15.17:0/2639391035 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7eff000a9c00 msgr2=0x7eff000b5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:36.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.595+0000 7efefffff640 1 --2- 172.21.15.17:0/2639391035 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7eff000a9c00 0x7eff000b5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:36.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.595+0000 7efefffff640 1 -- 172.21.15.17:0/2639391035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff0013b540 msgr2=0x7eff00132aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:36.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.595+0000 7efefffff640 1 --2- 172.21.15.17:0/2639391035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff0013b540 0x7eff00132aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:36.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.595+0000 7efefffff640 1 -- 172.21.15.17:0/2639391035 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff00151c70 con 0x7eff000b8e30 2024-04-17T02:22:36.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.596+0000 7efefffff640 1 --2- 172.21.15.17:0/2639391035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff000b8e30 0x7eff00132560 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efee800c7a0 tx=0x7efee800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:36.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.596+0000 7efefd7fa640 1 -- 172.21.15.17:0/2639391035 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee800a5e0 con 0x7eff000b8e30 2024-04-17T02:22:36.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.596+0000 7efefd7fa640 1 -- 172.21.15.17:0/2639391035 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efee800a7a0 con 0x7eff000b8e30 2024-04-17T02:22:36.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.596+0000 7eff06c38640 1 -- 172.21.15.17:0/2639391035 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff00133ac0 con 0x7eff000b8e30 2024-04-17T02:22:36.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.596+0000 7efefd7fa640 1 -- 172.21.15.17:0/2639391035 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee800ab90 con 0x7eff000b8e30 2024-04-17T02:22:36.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.596+0000 7eff06c38640 1 -- 172.21.15.17:0/2639391035 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff001331b0 con 0x7eff000b8e30 2024-04-17T02:22:36.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.597+0000 7eff06c38640 1 -- 172.21.15.17:0/2639391035 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff000687f0 con 0x7eff000b8e30 2024-04-17T02:22:36.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.598+0000 7efefd7fa640 1 -- 172.21.15.17:0/2639391035 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7efee8007070 con 0x7eff000b8e30 2024-04-17T02:22:36.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.598+0000 7efefd7fa640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:36.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.598+0000 7efefd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:36.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.598+0000 7efefd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:36.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.598+0000 7efefd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:36.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.598+0000 7efefd7fa640 1 --2- 172.21.15.17:0/2639391035 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7efee009f480 0x7efee00a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:36.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.598+0000 7eff049d4640 1 --2- 172.21.15.17:0/2639391035 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7efee009f480 0x7efee00a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:36.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.598+0000 7efefd7fa640 1 -- 172.21.15.17:0/2639391035 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7efee80c9350 con 0x7eff000b8e30 2024-04-17T02:22:36.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.599+0000 7eff049d4640 1 --2- 172.21.15.17:0/2639391035 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7efee009f480 0x7efee00a1940 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efef0000f60 tx=0x7efef0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:36.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.602+0000 7efefd7fa640 1 -- 172.21.15.17:0/2639391035 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7efee80983b0 con 0x7eff000b8e30 2024-04-17T02:22:36.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.785+0000 7eff06c38640 1 -- 172.21.15.17:0/2639391035 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7eff000a5d70 con 0x7eff000b8e30 2024-04-17T02:22:36.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.785+0000 7efefd7fa640 1 -- 172.21.15.17:0/2639391035 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7efee8097cb0 con 0x7eff000b8e30 2024-04-17T02:22:36.787 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-04-17T02:22:36.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.787+0000 7eff06c38640 10 mgrc shutdown 2024-04-17T02:22:36.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.788+0000 7eff06c38640 1 -- 172.21.15.17:0/2639391035 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7efee009f480 msgr2=0x7efee00a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:36.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.788+0000 7eff06c38640 1 --2- 172.21.15.17:0/2639391035 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7efee009f480 0x7efee00a1940 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efef0000f60 tx=0x7efef0009040 comp rx=0 tx=0).stop 2024-04-17T02:22:36.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.788+0000 7eff06c38640 1 -- 172.21.15.17:0/2639391035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff000b8e30 msgr2=0x7eff00132560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:36.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.788+0000 7eff06c38640 1 --2- 172.21.15.17:0/2639391035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff000b8e30 0x7eff00132560 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efee800c7a0 tx=0x7efee800cc60 comp rx=0 tx=0).stop 2024-04-17T02:22:36.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.788+0000 7eff06c38640 1 -- 172.21.15.17:0/2639391035 shutdown_connections 2024-04-17T02:22:36.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.788+0000 7eff06c38640 1 --2- 172.21.15.17:0/2639391035 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7efee009f480 0x7efee00a1940 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:36.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.788+0000 7eff06c38640 1 --2- 172.21.15.17:0/2639391035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff000b8e30 0x7eff00132560 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:36.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.788+0000 7eff06c38640 1 --2- 172.21.15.17:0/2639391035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff0013b540 0x7eff00132aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:36.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.788+0000 7eff06c38640 1 --2- 172.21.15.17:0/2639391035 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7eff000a9c00 0x7eff000b5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:36.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.788+0000 7eff06c38640 1 -- 172.21.15.17:0/2639391035 >> 172.21.15.17:0/2639391035 conn(0x7eff000741a0 msgr2=0x7eff00068ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:36.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.788+0000 7eff06c38640 1 -- 172.21.15.17:0/2639391035 shutdown_connections 2024-04-17T02:22:36.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.788+0000 7eff06c38640 1 -- 172.21.15.17:0/2639391035 wait complete. 2024-04-17T02:22:36.800 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T02:22:36.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.905+0000 7f4167fdb640 1 Processor -- start 2024-04-17T02:22:36.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.905+0000 7f4167fdb640 1 -- start start 2024-04-17T02:22:36.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.906+0000 7f4167fdb640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f41600ab5b0 0x7f41600ac680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:36.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.906+0000 7f4167fdb640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f41600bb460 0x7f4160142580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:36.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.906+0000 7f4167fdb640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41600acea0 con 0x7f4160142ac0 2024-04-17T02:22:36.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.906+0000 7f4167fdb640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f41600ab990 con 0x7f41600ab5b0 2024-04-17T02:22:36.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.906+0000 7f4167fdb640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f416006c330 con 0x7f41600bb460 2024-04-17T02:22:36.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.906+0000 7f4165d77640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f41600ab5b0 0x7f41600ac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:36.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.906+0000 7f4165d77640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f41600ab5b0 0x7f41600ac680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52654/0 (socket says 172.21.15.17:52654) 2024-04-17T02:22:36.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.906+0000 7f4165d77640 1 -- 172.21.15.17:0/1725641124 learned_addr learned my addr 172.21.15.17:0/1725641124 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:36.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.907+0000 7f4165576640 1 --2- 172.21.15.17:0/1725641124 >> v2:172.21.15.122:3300/0 conn(0x7f41600bb460 0x7f4160142580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:36.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.907+0000 7f4165d77640 1 -- 172.21.15.17:0/1725641124 >> v2:172.21.15.122:3300/0 conn(0x7f41600bb460 msgr2=0x7f4160142580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:36.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.907+0000 7f4165d77640 1 --2- 172.21.15.17:0/1725641124 >> v2:172.21.15.122:3300/0 conn(0x7f41600bb460 0x7f4160142580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:36.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.907+0000 7f4165d77640 1 -- 172.21.15.17:0/1725641124 >> v1:172.21.15.122:6789/0 conn(0x7f4160142ac0 legacy=0x7f4160148710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:36.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.907+0000 7f4165d77640 1 -- 172.21.15.17:0/1725641124 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41600acbc0 con 0x7f41600ab5b0 2024-04-17T02:22:36.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.907+0000 7f4165d77640 1 --2- 172.21.15.17:0/1725641124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41600ab5b0 0x7f41600ac680 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f416008b200 tx=0x7f415c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=448f135388409d8f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:36.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.907+0000 7f4164d75640 1 -- 172.21.15.17:0/1725641124 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415c035020 con 0x7f41600ab5b0 2024-04-17T02:22:36.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.908+0000 7f4164d75640 1 -- 172.21.15.17:0/1725641124 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f415c031870 con 0x7f41600ab5b0 2024-04-17T02:22:36.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.908+0000 7f4164d75640 1 -- 172.21.15.17:0/1725641124 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415c031c40 con 0x7f41600ab5b0 2024-04-17T02:22:36.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.908+0000 7f4167fdb640 1 -- 172.21.15.17:0/1725641124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41600ab5b0 msgr2=0x7f41600ac680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:36.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.908+0000 7f4167fdb640 1 --2- 172.21.15.17:0/1725641124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41600ab5b0 0x7f41600ac680 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f416008b200 tx=0x7f415c02b910 comp rx=0 tx=0).stop 2024-04-17T02:22:36.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.908+0000 7f4167fdb640 1 -- 172.21.15.17:0/1725641124 shutdown_connections 2024-04-17T02:22:36.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.908+0000 7f4167fdb640 1 --2- 172.21.15.17:0/1725641124 >> v2:172.21.15.122:3300/0 conn(0x7f41600bb460 0x7f4160142580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:36.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.908+0000 7f4167fdb640 1 --2- 172.21.15.17:0/1725641124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41600ab5b0 0x7f41600ac680 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:36.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.908+0000 7f4167fdb640 1 -- 172.21.15.17:0/1725641124 >> 172.21.15.17:0/1725641124 conn(0x7f41600ba940 msgr2=0x7f41600bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:36.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.908+0000 7f4167fdb640 1 -- 172.21.15.17:0/1725641124 shutdown_connections 2024-04-17T02:22:36.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.908+0000 7f4167fdb640 1 -- 172.21.15.17:0/1725641124 wait complete. 2024-04-17T02:22:36.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.909+0000 7f4167fdb640 1 Processor -- start 2024-04-17T02:22:36.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.909+0000 7f4167fdb640 1 -- start start 2024-04-17T02:22:36.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.910+0000 7f4167fdb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41600ab5b0 0x7f4160147f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:36.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.910+0000 7f4167fdb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41600bb460 0x7f41600af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:36.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.910+0000 7f4167fdb640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f4160142ac0 0x7f41600af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:36.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.910+0000 7f4167fdb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f41600a9700 con 0x7f41600ab5b0 2024-04-17T02:22:36.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.910+0000 7f4167fdb640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f41600a7400 con 0x7f41600bb460 2024-04-17T02:22:36.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.910+0000 7f4167fdb640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f41600a9880 con 0x7f4160142ac0 2024-04-17T02:22:36.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.910+0000 7f4165d77640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41600ab5b0 0x7f4160147f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:36.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.910+0000 7f4165d77640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41600ab5b0 0x7f4160147f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52670/0 (socket says 172.21.15.17:52670) 2024-04-17T02:22:36.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.910+0000 7f4166578640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f4160142ac0 0x7f41600af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:36.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.910+0000 7f4165d77640 1 -- 172.21.15.17:0/485767929 learned_addr learned my addr 172.21.15.17:0/485767929 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:36.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.910+0000 7f4165576640 1 --2- 172.21.15.17:0/485767929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41600bb460 0x7f41600af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:36.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.910+0000 7f4165d77640 1 -- 172.21.15.17:0/485767929 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f4160142ac0 msgr2=0x7f41600af6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:36.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.910+0000 7f4165d77640 1 --2- 172.21.15.17:0/485767929 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f4160142ac0 0x7f41600af6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:36.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.910+0000 7f4165d77640 1 -- 172.21.15.17:0/485767929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41600bb460 msgr2=0x7f41600af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:36.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.910+0000 7f4165d77640 1 --2- 172.21.15.17:0/485767929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41600bb460 0x7f41600af1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:36.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.910+0000 7f4165d77640 1 -- 172.21.15.17:0/485767929 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41601485a0 con 0x7f41600ab5b0 2024-04-17T02:22:36.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.910+0000 7f4165d77640 1 --2- 172.21.15.17:0/485767929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41600ab5b0 0x7f4160147f80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f415c000c00 tx=0x7f415c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:36.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.910+0000 7f41567fc640 1 -- 172.21.15.17:0/485767929 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415c03ad60 con 0x7f41600ab5b0 2024-04-17T02:22:36.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.910+0000 7f41567fc640 1 -- 172.21.15.17:0/485767929 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f415c0443f0 con 0x7f41600ab5b0 2024-04-17T02:22:36.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.910+0000 7f41567fc640 1 -- 172.21.15.17:0/485767929 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415c0447e0 con 0x7f41600ab5b0 2024-04-17T02:22:36.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.910+0000 7f4167fdb640 1 -- 172.21.15.17:0/485767929 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4160148840 con 0x7f41600ab5b0 2024-04-17T02:22:36.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.911+0000 7f4167fdb640 1 -- 172.21.15.17:0/485767929 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41601d1080 con 0x7f41600ab5b0 2024-04-17T02:22:36.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.911+0000 7f4167fdb640 1 -- 172.21.15.17:0/485767929 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41600687f0 con 0x7f41600ab5b0 2024-04-17T02:22:36.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.913+0000 7f41567fc640 1 -- 172.21.15.17:0/485767929 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f415c04b060 con 0x7f41600ab5b0 2024-04-17T02:22:36.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.913+0000 7f41567fc640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:36.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.913+0000 7f41567fc640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:36.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.913+0000 7f41567fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:36.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.913+0000 7f41567fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:36.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.913+0000 7f41567fc640 1 --2- 172.21.15.17:0/485767929 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f414409f480 0x7f41440a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:36.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.913+0000 7f4165576640 1 --2- 172.21.15.17:0/485767929 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f414409f480 0x7f41440a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:36.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.913+0000 7f41567fc640 1 -- 172.21.15.17:0/485767929 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f415c0eb9c0 con 0x7f41600ab5b0 2024-04-17T02:22:36.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.914+0000 7f4165576640 1 --2- 172.21.15.17:0/485767929 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f414409f480 0x7f41440a1940 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f416013ed00 tx=0x7f4150008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:36.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:36.916+0000 7f41567fc640 1 -- 172.21.15.17:0/485767929 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f415c03f070 con 0x7f41600ab5b0 2024-04-17T02:22:37.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.095+0000 7f4167fdb640 1 -- 172.21.15.17:0/485767929 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4160144a50 con 0x7f41600ab5b0 2024-04-17T02:22:37.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.096+0000 7f41567fc640 1 -- 172.21.15.17:0/485767929 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f415c0baa20 con 0x7f41600ab5b0 2024-04-17T02:22:37.097 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-04-17T02:22:37.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.097+0000 7f4167fdb640 10 mgrc shutdown 2024-04-17T02:22:37.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.097+0000 7f4167fdb640 1 -- 172.21.15.17:0/485767929 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f414409f480 msgr2=0x7f41440a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:37.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.097+0000 7f4167fdb640 1 --2- 172.21.15.17:0/485767929 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f414409f480 0x7f41440a1940 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f416013ed00 tx=0x7f4150008040 comp rx=0 tx=0).stop 2024-04-17T02:22:37.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.098+0000 7f4167fdb640 1 -- 172.21.15.17:0/485767929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41600ab5b0 msgr2=0x7f4160147f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:37.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.098+0000 7f4167fdb640 1 --2- 172.21.15.17:0/485767929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41600ab5b0 0x7f4160147f80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f415c000c00 tx=0x7f415c0046c0 comp rx=0 tx=0).stop 2024-04-17T02:22:37.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.098+0000 7f4167fdb640 1 -- 172.21.15.17:0/485767929 shutdown_connections 2024-04-17T02:22:37.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.098+0000 7f4167fdb640 1 --2- 172.21.15.17:0/485767929 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f414409f480 0x7f41440a1940 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:37.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.098+0000 7f4167fdb640 1 --2- 172.21.15.17:0/485767929 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f4160142ac0 0x7f41600af6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:37.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.098+0000 7f4167fdb640 1 --2- 172.21.15.17:0/485767929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41600bb460 0x7f41600af1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:37.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.098+0000 7f4167fdb640 1 --2- 172.21.15.17:0/485767929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41600ab5b0 0x7f4160147f80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:37.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.098+0000 7f4167fdb640 1 -- 172.21.15.17:0/485767929 >> 172.21.15.17:0/485767929 conn(0x7f41600ba940 msgr2=0x7f416013e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:37.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.098+0000 7f4167fdb640 1 -- 172.21.15.17:0/485767929 shutdown_connections 2024-04-17T02:22:37.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.098+0000 7f4167fdb640 1 -- 172.21.15.17:0/485767929 wait complete. 2024-04-17T02:22:37.109 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T02:22:37.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.211+0000 7f851f51e640 1 Processor -- start 2024-04-17T02:22:37.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.212+0000 7f851f51e640 1 -- start start 2024-04-17T02:22:37.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.212+0000 7f851f51e640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8518142c90 0x7f8518150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:37.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.212+0000 7f851f51e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85180acea0 con 0x7f85180bb460 2024-04-17T02:22:37.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.212+0000 7f851f51e640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f851806dd30 con 0x7f85180ab5b0 2024-04-17T02:22:37.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.212+0000 7f851f51e640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f85180ab990 con 0x7f8518142c90 2024-04-17T02:22:37.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.212+0000 7f851cab9640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f85180bb460 0x7f8518142580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42088/0 (socket says 172.21.15.17:42088) 2024-04-17T02:22:37.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.212+0000 7f851cab9640 1 -- 172.21.15.17:0/1875072275 learned_addr learned my addr 172.21.15.17:0/1875072275 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:22:37.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.212+0000 7f850ffff640 1 -- 172.21.15.17:0/1875072275 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1443348238 0 0) 0x7f85180acea0 con 0x7f85180bb460 2024-04-17T02:22:37.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.212+0000 7f850ffff640 1 -- 172.21.15.17:0/1875072275 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8504003520 con 0x7f85180bb460 2024-04-17T02:22:37.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.212+0000 7f851dabb640 1 --2- 172.21.15.17:0/1875072275 >> v2:172.21.15.122:3300/0 conn(0x7f8518142c90 0x7f8518150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:37.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.213+0000 7f850ffff640 1 -- 172.21.15.17:0/1875072275 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3376459638 0 0) 0x7f8504003520 con 0x7f85180bb460 2024-04-17T02:22:37.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.213+0000 7f850ffff640 1 -- 172.21.15.17:0/1875072275 >> v2:172.21.15.122:3300/0 conn(0x7f8518142c90 msgr2=0x7f8518150aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:37.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.213+0000 7f850ffff640 1 --2- 172.21.15.17:0/1875072275 >> v2:172.21.15.122:3300/0 conn(0x7f8518142c90 0x7f8518150aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:37.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.213+0000 7f850ffff640 1 -- 172.21.15.17:0/1875072275 >> v1:172.21.15.122:6789/0 conn(0x7f85180ab5b0 legacy=0x7f85180ac680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:37.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.213+0000 7f850ffff640 1 -- 172.21.15.17:0/1875072275 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85180a7400 con 0x7f85180bb460 2024-04-17T02:22:37.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.213+0000 7f850ffff640 1 -- 172.21.15.17:0/1875072275 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1752030744 0 0) 0x7f8508001670 con 0x7f85180bb460 2024-04-17T02:22:37.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.213+0000 7f850ffff640 1 -- 172.21.15.17:0/1875072275 >> v1:172.21.15.17:6789/0 conn(0x7f85180bb460 legacy=0x7f8518142580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:37.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.213+0000 7f850ffff640 1 --2- 172.21.15.17:0/1875072275 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f85040039b0 0x7f8504003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:37.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.213+0000 7f850ffff640 1 --2- 172.21.15.17:0/1875072275 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8504004800 0x7f8504004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:37.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.213+0000 7f850ffff640 1 --2- 172.21.15.17:0/1875072275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85040051c0 0x7f850400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:37.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.213+0000 7f850ffff640 1 -- 172.21.15.17:0/1875072275 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f85180ab990 con 0x7f85040051c0 2024-04-17T02:22:37.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.213+0000 7f850ffff640 1 -- 172.21.15.17:0/1875072275 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f850400c060 con 0x7f8504004800 2024-04-17T02:22:37.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.213+0000 7f850ffff640 1 -- 172.21.15.17:0/1875072275 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f850400c260 con 0x7f85040039b0 2024-04-17T02:22:37.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.213+0000 7f851d2ba640 1 --2- 172.21.15.17:0/1875072275 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f85040039b0 0x7f8504003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:37.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.213+0000 7f851dabb640 1 --2- 172.21.15.17:0/1875072275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85040051c0 0x7f850400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:37.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.213+0000 7f851cab9640 1 --2- 172.21.15.17:0/1875072275 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8504004800 0x7f8504004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:37.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.213+0000 7f851dabb640 1 -- 172.21.15.17:0/1875072275 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f85040039b0 msgr2=0x7f8504003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:37.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.213+0000 7f851dabb640 1 --2- 172.21.15.17:0/1875072275 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f85040039b0 0x7f8504003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:37.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.213+0000 7f851dabb640 1 -- 172.21.15.17:0/1875072275 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8504004800 msgr2=0x7f8504004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:37.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.213+0000 7f851dabb640 1 --2- 172.21.15.17:0/1875072275 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8504004800 0x7f8504004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:37.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.213+0000 7f851dabb640 1 -- 172.21.15.17:0/1875072275 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8504003520 con 0x7f85040051c0 2024-04-17T02:22:37.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.213+0000 7f851d2ba640 1 --2- 172.21.15.17:0/1875072275 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f85040039b0 0x7f8504003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:37.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.213+0000 7f851cab9640 1 --2- 172.21.15.17:0/1875072275 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8504004800 0x7f8504004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:37.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.214+0000 7f851dabb640 1 -- 172.21.15.17:0/1875072275 reap_dead start 2024-04-17T02:22:37.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.214+0000 7f851dabb640 1 --2- 172.21.15.17:0/1875072275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85040051c0 0x7f850400b9c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f85181430a0 tx=0x7f8504005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=727284932ef34921 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:37.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.214+0000 7f850ffff640 1 -- 172.21.15.17:0/1875072275 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8514001370 con 0x7f85040051c0 2024-04-17T02:22:37.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.214+0000 7f850ffff640 1 -- 172.21.15.17:0/1875072275 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f851002cbd0 con 0x7f85040051c0 2024-04-17T02:22:37.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.214+0000 7f850ffff640 1 -- 172.21.15.17:0/1875072275 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8508007d30 con 0x7f85040051c0 2024-04-17T02:22:37.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.215+0000 7f851f51e640 1 -- 172.21.15.17:0/1875072275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85040051c0 msgr2=0x7f850400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:37.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.215+0000 7f851f51e640 1 --2- 172.21.15.17:0/1875072275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85040051c0 0x7f850400b9c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f85181430a0 tx=0x7f8504005830 comp rx=0 tx=0).stop 2024-04-17T02:22:37.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.215+0000 7f851f51e640 1 -- 172.21.15.17:0/1875072275 shutdown_connections 2024-04-17T02:22:37.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.215+0000 7f851f51e640 1 --2- 172.21.15.17:0/1875072275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85040051c0 0x7f850400b9c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:37.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.215+0000 7f851f51e640 1 -- 172.21.15.17:0/1875072275 >> 172.21.15.17:0/1875072275 conn(0x7f85180ba940 msgr2=0x7f85180bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:37.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.215+0000 7f851f51e640 1 -- 172.21.15.17:0/1875072275 shutdown_connections 2024-04-17T02:22:37.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.215+0000 7f851f51e640 1 -- 172.21.15.17:0/1875072275 wait complete. 2024-04-17T02:22:37.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.216+0000 7f851f51e640 1 Processor -- start 2024-04-17T02:22:37.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.216+0000 7f851f51e640 1 -- start start 2024-04-17T02:22:37.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.216+0000 7f851f51e640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f85040051c0 0x7f85181ce560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:37.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.216+0000 7f851f51e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85181daa40 0x7f85181456a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:37.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.216+0000 7f851f51e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f851813d310 0x7f85181cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:37.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.216+0000 7f851f51e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8518142580 con 0x7f851813d310 2024-04-17T02:22:37.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.216+0000 7f851f51e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8518142700 con 0x7f85181daa40 2024-04-17T02:22:37.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.216+0000 7f851f51e640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f8518142880 con 0x7f85040051c0 2024-04-17T02:22:37.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.216+0000 7f851d2ba640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f85040051c0 0x7f85181ce560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:37.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.216+0000 7f851d2ba640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f85040051c0 0x7f85181ce560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:53264/0 (socket says 172.21.15.17:53264) 2024-04-17T02:22:37.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.216+0000 7f851d2ba640 1 -- 172.21.15.17:0/2102683495 learned_addr learned my addr 172.21.15.17:0/2102683495 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:37.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.216+0000 7f851dabb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f851813d310 0x7f85181cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:37.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.217+0000 7f851cab9640 1 --2- 172.21.15.17:0/2102683495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85181daa40 0x7f85181456a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:37.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.217+0000 7f851d2ba640 1 -- 172.21.15.17:0/2102683495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85181daa40 msgr2=0x7f85181456a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:37.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.217+0000 7f851d2ba640 1 --2- 172.21.15.17:0/2102683495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85181daa40 0x7f85181456a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:37.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.217+0000 7f851d2ba640 1 -- 172.21.15.17:0/2102683495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f851813d310 msgr2=0x7f85181cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:37.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.217+0000 7f851d2ba640 1 --2- 172.21.15.17:0/2102683495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f851813d310 0x7f85181cfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:37.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.217+0000 7f851d2ba640 1 -- 172.21.15.17:0/2102683495 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85181daef0 con 0x7f85040051c0 2024-04-17T02:22:37.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.217+0000 7f851dabb640 1 --2- 172.21.15.17:0/2102683495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f851813d310 0x7f85181cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:37.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.217+0000 7f851d2ba640 1 --2- 172.21.15.17:0/2102683495 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f85040051c0 0x7f85181ce560 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f851400f5f0 tx=0x7f851400fab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:37.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.217+0000 7f850dffb640 1 -- 172.21.15.17:0/2102683495 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85140052e0 con 0x7f85040051c0 2024-04-17T02:22:37.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.217+0000 7f850dffb640 1 -- 172.21.15.17:0/2102683495 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8514018070 con 0x7f85040051c0 2024-04-17T02:22:37.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.217+0000 7f850dffb640 1 -- 172.21.15.17:0/2102683495 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8514003810 con 0x7f85040051c0 2024-04-17T02:22:37.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.217+0000 7f851f51e640 1 -- 172.21.15.17:0/2102683495 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8518145be0 con 0x7f85040051c0 2024-04-17T02:22:37.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.217+0000 7f851f51e640 1 -- 172.21.15.17:0/2102683495 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f85181db1b0 con 0x7f85040051c0 2024-04-17T02:22:37.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.218+0000 7f851f51e640 1 -- 172.21.15.17:0/2102683495 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85180a8630 con 0x7f85040051c0 2024-04-17T02:22:37.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.219+0000 7f850dffb640 1 -- 172.21.15.17:0/2102683495 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f85140039b0 con 0x7f85040051c0 2024-04-17T02:22:37.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.219+0000 7f850dffb640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:37.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.220+0000 7f850dffb640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:37.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.220+0000 7f850dffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:37.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.220+0000 7f850dffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:37.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.220+0000 7f850dffb640 1 --2- 172.21.15.17:0/2102683495 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f84fc09f480 0x7f84fc0a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:37.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.220+0000 7f851cab9640 1 --2- 172.21.15.17:0/2102683495 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f84fc09f480 0x7f84fc0a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:37.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.220+0000 7f850dffb640 1 -- 172.21.15.17:0/2102683495 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f85140c92c0 con 0x7f85040051c0 2024-04-17T02:22:37.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.220+0000 7f851cab9640 1 --2- 172.21.15.17:0/2102683495 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f84fc09f480 0x7f84fc0a1940 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8508000fb0 tx=0x7f8508009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:37.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.224+0000 7f850dffb640 1 -- 172.21.15.17:0/2102683495 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f85180a8630 con 0x7f85040051c0 2024-04-17T02:22:37.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.443+0000 7f851f51e640 1 -- 172.21.15.17:0/2102683495 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85180687f0 con 0x7f85040051c0 2024-04-17T02:22:37.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.443+0000 7f850dffb640 1 -- 172.21.15.17:0/2102683495 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4348 (secure 0 0 0) 0x7f8514098320 con 0x7f85040051c0 2024-04-17T02:22:37.444 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:22:37.444 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4228,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6813/1946927344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6811","nonce":1946927344},{"type":"v1","addr":"172.21.15.17:6813","nonce":1946927344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4234,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6825/529920036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":529920036},{"type":"v1","addr":"172.21.15.122:6825","nonce":529920036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T02:22:21.611698+0000","modified":"2024-04-17T02:22:23.609137+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6812/356803728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":356803728},{"type":"v1","addr":"172.21.15.17:6812","nonce":356803728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4254,"qdb_cluster":[4254]},"id":1}]} 2024-04-17T02:22:37.445 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 6 2024-04-17T02:22:37.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.445+0000 7f851f51e640 10 mgrc shutdown 2024-04-17T02:22:37.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.445+0000 7f851f51e640 1 -- 172.21.15.17:0/2102683495 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f84fc09f480 msgr2=0x7f84fc0a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:37.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.445+0000 7f851f51e640 1 --2- 172.21.15.17:0/2102683495 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f84fc09f480 0x7f84fc0a1940 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8508000fb0 tx=0x7f8508009040 comp rx=0 tx=0).stop 2024-04-17T02:22:37.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.445+0000 7f851f51e640 1 -- 172.21.15.17:0/2102683495 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f85040051c0 msgr2=0x7f85181ce560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:37.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.445+0000 7f851f51e640 1 --2- 172.21.15.17:0/2102683495 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f85040051c0 0x7f85181ce560 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f851400f5f0 tx=0x7f851400fab0 comp rx=0 tx=0).stop 2024-04-17T02:22:37.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.445+0000 7f851f51e640 1 -- 172.21.15.17:0/2102683495 shutdown_connections 2024-04-17T02:22:37.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.445+0000 7f851f51e640 1 --2- 172.21.15.17:0/2102683495 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f84fc09f480 0x7f84fc0a1940 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:37.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.445+0000 7f851f51e640 1 --2- 172.21.15.17:0/2102683495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f851813d310 0x7f85181cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:37.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.445+0000 7f851f51e640 1 --2- 172.21.15.17:0/2102683495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85181daa40 0x7f85181456a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:37.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.445+0000 7f851f51e640 1 --2- 172.21.15.17:0/2102683495 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f85040051c0 0x7f85181ce560 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:37.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.445+0000 7f851f51e640 1 -- 172.21.15.17:0/2102683495 >> 172.21.15.17:0/2102683495 conn(0x7f85180ba940 msgr2=0x7f85180a76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:37.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.445+0000 7f851f51e640 1 -- 172.21.15.17:0/2102683495 shutdown_connections 2024-04-17T02:22:37.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.445+0000 7f851f51e640 1 -- 172.21.15.17:0/2102683495 wait complete. 2024-04-17T02:22:37.458 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T02:22:37.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.561+0000 7f040ce34640 1 Processor -- start 2024-04-17T02:22:37.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.561+0000 7f040ce34640 1 -- start start 2024-04-17T02:22:37.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.561+0000 7f040ce34640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f04080ab3b0 0x7f04080ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:37.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.561+0000 7f040ce34640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04080a7f00 con 0x7f04080acce0 2024-04-17T02:22:37.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.561+0000 7f040ce34640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04080abd20 con 0x7f04080a9560 2024-04-17T02:22:37.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.561+0000 7f040ce34640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f04080ac000 con 0x7f04080ab3b0 2024-04-17T02:22:37.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.562+0000 7f0406d9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f04080acce0 0x7f040814f960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42092/0 (socket says 172.21.15.17:42092) 2024-04-17T02:22:37.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.562+0000 7f0406d9d640 1 -- 172.21.15.17:0/3696307063 learned_addr learned my addr 172.21.15.17:0/3696307063 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:22:37.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.562+0000 7f040659c640 1 --2- 172.21.15.17:0/3696307063 >> v2:172.21.15.122:3300/0 conn(0x7f04080ab3b0 0x7f04080ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:37.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.562+0000 7f040559a640 1 -- 172.21.15.17:0/3696307063 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1765799451 0 0) 0x7f04080a7f00 con 0x7f04080acce0 2024-04-17T02:22:37.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.562+0000 7f040559a640 1 -- 172.21.15.17:0/3696307063 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03f4003520 con 0x7f04080acce0 2024-04-17T02:22:37.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.562+0000 7f040659c640 1 -- 172.21.15.17:0/3696307063 >> v1:172.21.15.122:6789/0 conn(0x7f04080a9560 legacy=0x7f0408145730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:37.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.562+0000 7f040559a640 1 -- 172.21.15.17:0/3696307063 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2993549656 0 0) 0x7f03f4003520 con 0x7f04080acce0 2024-04-17T02:22:37.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.562+0000 7f040659c640 1 -- 172.21.15.17:0/3696307063 >> v1:172.21.15.17:6789/0 conn(0x7f04080acce0 legacy=0x7f040814f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:37.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.562+0000 7f040659c640 1 -- 172.21.15.17:0/3696307063 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04080a7960 con 0x7f04080ab3b0 2024-04-17T02:22:37.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.563+0000 7f040659c640 1 --2- 172.21.15.17:0/3696307063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04080ab3b0 0x7f04080ac7a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f04080a7b90 tx=0x7f040002bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4095101d7256c839 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:37.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.563+0000 7f040559a640 1 -- 172.21.15.17:0/3696307063 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0400039070 con 0x7f04080ab3b0 2024-04-17T02:22:37.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.563+0000 7f040559a640 1 -- 172.21.15.17:0/3696307063 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f040002c8a0 con 0x7f04080ab3b0 2024-04-17T02:22:37.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.563+0000 7f040559a640 1 -- 172.21.15.17:0/3696307063 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f8001670 con 0x7f04080ab3b0 2024-04-17T02:22:37.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.563+0000 7f040ce34640 1 -- 172.21.15.17:0/3696307063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04080ab3b0 msgr2=0x7f04080ac7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:37.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.563+0000 7f040ce34640 1 --2- 172.21.15.17:0/3696307063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04080ab3b0 0x7f04080ac7a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f04080a7b90 tx=0x7f040002bd70 comp rx=0 tx=0).stop 2024-04-17T02:22:37.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.564+0000 7f040ce34640 1 -- 172.21.15.17:0/3696307063 shutdown_connections 2024-04-17T02:22:37.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.564+0000 7f040ce34640 1 --2- 172.21.15.17:0/3696307063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04080ab3b0 0x7f04080ac7a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:37.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.564+0000 7f040ce34640 1 -- 172.21.15.17:0/3696307063 >> 172.21.15.17:0/3696307063 conn(0x7f04080a9b60 msgr2=0x7f04080a9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:37.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.564+0000 7f040ce34640 1 -- 172.21.15.17:0/3696307063 shutdown_connections 2024-04-17T02:22:37.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.564+0000 7f040ce34640 1 -- 172.21.15.17:0/3696307063 wait complete. 2024-04-17T02:22:37.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.565+0000 7f040ce34640 1 Processor -- start 2024-04-17T02:22:37.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.565+0000 7f040ce34640 1 -- start start 2024-04-17T02:22:37.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.565+0000 7f040ce34640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04080a9560 0x7f040814c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:37.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.565+0000 7f040ce34640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04080ab3b0 0x7f0408142db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:37.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.565+0000 7f040ce34640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f04080acce0 0x7f04081432f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:37.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.565+0000 7f040ce34640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f040806b5b0 con 0x7f04080ab3b0 2024-04-17T02:22:37.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.565+0000 7f040ce34640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0408145e40 con 0x7f04080a9560 2024-04-17T02:22:37.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.565+0000 7f040ce34640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f0408143a20 con 0x7f04080acce0 2024-04-17T02:22:37.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.565+0000 7f0405d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04080ab3b0 0x7f0408142db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:37.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.565+0000 7f0406d9d640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f04080acce0 0x7f04081432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:37.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.565+0000 7f0406d9d640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f04080acce0 0x7f04081432f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:53280/0 (socket says 172.21.15.17:53280) 2024-04-17T02:22:37.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.566+0000 7f0406d9d640 1 -- 172.21.15.17:0/2111614714 learned_addr learned my addr 172.21.15.17:0/2111614714 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:37.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.565+0000 7f0405d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04080ab3b0 0x7f0408142db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52700/0 (socket says 172.21.15.17:52700) 2024-04-17T02:22:37.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.566+0000 7f040659c640 1 --2- 172.21.15.17:0/2111614714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04080a9560 0x7f040814c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:37.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.566+0000 7f0406d9d640 1 -- 172.21.15.17:0/2111614714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04080a9560 msgr2=0x7f040814c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:37.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.566+0000 7f0406d9d640 1 --2- 172.21.15.17:0/2111614714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04080a9560 0x7f040814c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:37.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.566+0000 7f0406d9d640 1 -- 172.21.15.17:0/2111614714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04080ab3b0 msgr2=0x7f0408142db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:37.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.566+0000 7f0406d9d640 1 --2- 172.21.15.17:0/2111614714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04080ab3b0 0x7f0408142db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:37.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.566+0000 7f0406d9d640 1 -- 172.21.15.17:0/2111614714 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0408149e00 con 0x7f04080acce0 2024-04-17T02:22:37.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.566+0000 7f0406d9d640 1 --2- 172.21.15.17:0/2111614714 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f04080acce0 0x7f04081432f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f03f8007fd0 tx=0x7f03f800c9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:37.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.566+0000 7f03feffd640 1 -- 172.21.15.17:0/2111614714 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f8017070 con 0x7f04080acce0 2024-04-17T02:22:37.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.566+0000 7f03feffd640 1 -- 172.21.15.17:0/2111614714 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03f8005ce0 con 0x7f04080acce0 2024-04-17T02:22:37.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.566+0000 7f040ce34640 1 -- 172.21.15.17:0/2111614714 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f040814be70 con 0x7f04080acce0 2024-04-17T02:22:37.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.566+0000 7f03feffd640 1 -- 172.21.15.17:0/2111614714 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f80072f0 con 0x7f04080acce0 2024-04-17T02:22:37.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.566+0000 7f040ce34640 1 -- 172.21.15.17:0/2111614714 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f04081427e0 con 0x7f04080acce0 2024-04-17T02:22:37.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.567+0000 7f040ce34640 1 -- 172.21.15.17:0/2111614714 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04081509c0 con 0x7f04080acce0 2024-04-17T02:22:37.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.568+0000 7f03feffd640 1 -- 172.21.15.17:0/2111614714 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f03f801a070 con 0x7f04080acce0 2024-04-17T02:22:37.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.568+0000 7f03feffd640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:37.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.569+0000 7f03feffd640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:37.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.569+0000 7f03feffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:37.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.569+0000 7f03feffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:37.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.569+0000 7f03feffd640 1 --2- 172.21.15.17:0/2111614714 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f03e809f480 0x7f03e80a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:37.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.569+0000 7f040659c640 1 --2- 172.21.15.17:0/2111614714 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f03e809f480 0x7f03e80a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:37.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.569+0000 7f03feffd640 1 -- 172.21.15.17:0/2111614714 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f03f80c8d30 con 0x7f04080acce0 2024-04-17T02:22:37.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.569+0000 7f040659c640 1 --2- 172.21.15.17:0/2111614714 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f03e809f480 0x7f03e80a1940 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0400036000 tx=0x7f0400030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:37.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.572+0000 7f03feffd640 1 -- 172.21.15.17:0/2111614714 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f04081509c0 con 0x7f04080acce0 2024-04-17T02:22:37.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.756+0000 7f040ce34640 1 -- 172.21.15.17:0/2111614714 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f040814c330 con 0x7f04080acce0 2024-04-17T02:22:37.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.757+0000 7f03feffd640 1 -- 172.21.15.17:0/2111614714 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+13561 (secure 0 0 0) 0x7f03f8021020 con 0x7f04080acce0 2024-04-17T02:22:37.758 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:22:37.759 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":20,"fsid":"7cbfae20-b10d-41da-92b7-cbd5c1632e23","created":"2024-04-17T02:22:00.246446+0000","modified":"2024-04-17T02:22:23.241120+0000","last_up_change":"2024-04-17T02:22:09.077928+0000","last_in_change":"2024-04-17T02:22:01.415384+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T02:22:10.533377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-17T02:22:15.947495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-17T02:22:20.016616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-17T02:22:20.573938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2973665c-6c5e-4688-bffe-72d3bdcf467f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6801","nonce":1828284343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6803","nonce":1828284343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6807","nonce":1828284343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6805","nonce":1828284343}]},"public_addr":"172.21.15.17:6801/1828284343","cluster_addr":"172.21.15.17:6803/1828284343","heartbeat_back_addr":"172.21.15.17:6807/1828284343","heartbeat_front_addr":"172.21.15.17:6805/1828284343","state":["exists","up"]},{"osd":1,"uuid":"a59a034d-19b4-47e8-8ca5-538597b4af1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6809","nonce":2064593011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6811","nonce":2064593011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6815","nonce":2064593011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6813","nonce":2064593011}]},"public_addr":"172.21.15.122:6809/2064593011","cluster_addr":"172.21.15.122:6811/2064593011","heartbeat_back_addr":"172.21.15.122:6815/2064593011","heartbeat_front_addr":"172.21.15.122:6813/2064593011","state":["exists","up"]},{"osd":2,"uuid":"070f4c5f-459f-46ff-b980-05b1ac50c951","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6817","nonce":929092547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6819","nonce":929092547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6823","nonce":929092547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6821","nonce":929092547}]},"public_addr":"172.21.15.122:6817/929092547","cluster_addr":"172.21.15.122:6819/929092547","heartbeat_back_addr":"172.21.15.122:6823/929092547","heartbeat_front_addr":"172.21.15.122:6821/929092547","state":["exists","up"]},{"osd":3,"uuid":"96216a49-a7b6-40eb-bc93-cc8c78a5270a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6801","nonce":204132523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6803","nonce":204132523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6807","nonce":204132523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6805","nonce":204132523}]},"public_addr":"172.21.15.122:6801/204132523","cluster_addr":"172.21.15.122:6803/204132523","heartbeat_back_addr":"172.21.15.122:6807/204132523","heartbeat_front_addr":"172.21.15.122:6805/204132523","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.477173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.522791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.590625+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.480698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T02:22:37.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.759+0000 7f040ce34640 10 mgrc shutdown 2024-04-17T02:22:37.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.759+0000 7f040ce34640 1 -- 172.21.15.17:0/2111614714 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f03e809f480 msgr2=0x7f03e80a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:37.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.759+0000 7f040ce34640 1 --2- 172.21.15.17:0/2111614714 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f03e809f480 0x7f03e80a1940 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0400036000 tx=0x7f0400030000 comp rx=0 tx=0).stop 2024-04-17T02:22:37.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.759+0000 7f040ce34640 1 -- 172.21.15.17:0/2111614714 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f04080acce0 msgr2=0x7f04081432f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:37.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.759+0000 7f040ce34640 1 --2- 172.21.15.17:0/2111614714 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f04080acce0 0x7f04081432f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f03f8007fd0 tx=0x7f03f800c9b0 comp rx=0 tx=0).stop 2024-04-17T02:22:37.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.759+0000 7f040ce34640 1 -- 172.21.15.17:0/2111614714 shutdown_connections 2024-04-17T02:22:37.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.759+0000 7f040ce34640 1 --2- 172.21.15.17:0/2111614714 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f03e809f480 0x7f03e80a1940 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:37.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.759+0000 7f040ce34640 1 --2- 172.21.15.17:0/2111614714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04080ab3b0 0x7f0408142db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:37.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.759+0000 7f040ce34640 1 --2- 172.21.15.17:0/2111614714 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f04080acce0 0x7f04081432f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:37.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.759+0000 7f040ce34640 1 --2- 172.21.15.17:0/2111614714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04080a9560 0x7f040814c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:37.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.759+0000 7f040ce34640 1 -- 172.21.15.17:0/2111614714 >> 172.21.15.17:0/2111614714 conn(0x7f04080a9b60 msgr2=0x7f04080ba9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:37.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.760+0000 7f040ce34640 1 -- 172.21.15.17:0/2111614714 shutdown_connections 2024-04-17T02:22:37.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.760+0000 7f040ce34640 1 -- 172.21.15.17:0/2111614714 wait complete. 2024-04-17T02:22:37.772 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T02:22:10.533377+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-17T02:22:15.947495+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T02:22:20.016616+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T02:22:20.573938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.190000057220459, 'score_stable': 1.190000057220459, 'optimal_score': 1, 'raw_score_acting': 1.190000057220459, 'raw_score_stable': 1.190000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-17T02:22:37.772 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T02:22:37.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.878+0000 7feda693d640 1 Processor -- start 2024-04-17T02:22:37.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.878+0000 7feda693d640 1 -- start start 2024-04-17T02:22:37.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.878+0000 7feda693d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7feda006b370 0x7feda00a8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:37.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.878+0000 7feda693d640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7feda00a8270 0x7feda00733e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:37.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.878+0000 7feda693d640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feda0148d80 con 0x7feda00a9120 2024-04-17T02:22:37.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.878+0000 7feda693d640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7feda0149040 con 0x7feda006b370 2024-04-17T02:22:37.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.878+0000 7feda693d640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7feda006eb80 con 0x7feda00a8270 2024-04-17T02:22:37.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.878+0000 7feda4eda640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7feda00a8270 0x7feda00733e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:37.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.878+0000 7fed9ffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7feda006b370 0x7feda00a8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:37.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.878+0000 7fed97fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7feda00a9120 0x7feda0072cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42096/0 (socket says 172.21.15.17:42096) 2024-04-17T02:22:37.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.878+0000 7fed97fff640 1 -- 172.21.15.17:0/600762271 learned_addr learned my addr 172.21.15.17:0/600762271 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:22:37.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.879+0000 7feda4eda640 1 -- 172.21.15.17:0/600762271 >> v2:172.21.15.17:3300/0 conn(0x7feda006b370 msgr2=0x7feda00a8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:37.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.879+0000 7feda4eda640 1 --2- 172.21.15.17:0/600762271 >> v2:172.21.15.17:3300/0 conn(0x7feda006b370 0x7feda00a8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:37.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.879+0000 7feda4eda640 1 -- 172.21.15.17:0/600762271 >> v1:172.21.15.17:6789/0 conn(0x7feda00a9120 legacy=0x7feda0072cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:37.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.879+0000 7feda4eda640 1 -- 172.21.15.17:0/600762271 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda00a5f70 con 0x7feda00a8270 2024-04-17T02:22:37.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.879+0000 7fed9ffff640 1 --2- 172.21.15.17:0/600762271 >> v2:172.21.15.17:3300/0 conn(0x7feda006b370 0x7feda00a8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:37.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.879+0000 7feda4eda640 1 --2- 172.21.15.17:0/600762271 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7feda00a8270 0x7feda00733e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feda00a6200 tx=0x7fed9802be00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f24d2e8e89262b5e server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:37.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.880+0000 7fed9f7fe640 1 -- 172.21.15.17:0/600762271 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed98039070 con 0x7feda00a8270 2024-04-17T02:22:37.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.880+0000 7fed9f7fe640 1 -- 172.21.15.17:0/600762271 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed9802cbb0 con 0x7feda00a8270 2024-04-17T02:22:37.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.880+0000 7fed9f7fe640 1 -- 172.21.15.17:0/600762271 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed98034440 con 0x7feda00a8270 2024-04-17T02:22:37.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.880+0000 7feda693d640 1 -- 172.21.15.17:0/600762271 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7feda00a8270 msgr2=0x7feda00733e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:37.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.880+0000 7feda693d640 1 --2- 172.21.15.17:0/600762271 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7feda00a8270 0x7feda00733e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feda00a6200 tx=0x7fed9802be00 comp rx=0 tx=0).stop 2024-04-17T02:22:37.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.880+0000 7feda693d640 1 -- 172.21.15.17:0/600762271 shutdown_connections 2024-04-17T02:22:37.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.880+0000 7feda693d640 1 --2- 172.21.15.17:0/600762271 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7feda00a8270 0x7feda00733e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:37.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.880+0000 7feda693d640 1 --2- 172.21.15.17:0/600762271 >> v2:172.21.15.17:3300/0 conn(0x7feda006b370 0x7feda00a8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:37.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.880+0000 7feda693d640 1 -- 172.21.15.17:0/600762271 >> 172.21.15.17:0/600762271 conn(0x7feda00a6ab0 msgr2=0x7feda00a6ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:37.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.880+0000 7feda693d640 1 -- 172.21.15.17:0/600762271 shutdown_connections 2024-04-17T02:22:37.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.880+0000 7feda693d640 1 -- 172.21.15.17:0/600762271 wait complete. 2024-04-17T02:22:37.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.881+0000 7feda693d640 1 Processor -- start 2024-04-17T02:22:37.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.881+0000 7feda693d640 1 -- start start 2024-04-17T02:22:37.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.882+0000 7feda693d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feda006b370 0x7feda013db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:37.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.882+0000 7feda693d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feda00a8270 0x7feda009e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:37.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.882+0000 7feda693d640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7feda00a9120 0x7feda0144e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:37.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.882+0000 7feda693d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7feda01489c0 con 0x7feda00a8270 2024-04-17T02:22:37.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.882+0000 7feda693d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7feda0148840 con 0x7feda006b370 2024-04-17T02:22:37.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.882+0000 7feda693d640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7feda0148b40 con 0x7feda00a9120 2024-04-17T02:22:37.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.882+0000 7fed97fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feda00a8270 0x7feda009e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:37.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.882+0000 7feda4eda640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7feda00a9120 0x7feda0144e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:37.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.882+0000 7feda4eda640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7feda00a9120 0x7feda0144e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:53292/0 (socket says 172.21.15.17:53292) 2024-04-17T02:22:37.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.882+0000 7feda4eda640 1 -- 172.21.15.17:0/1783193595 learned_addr learned my addr 172.21.15.17:0/1783193595 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:37.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.882+0000 7fed97fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feda00a8270 0x7feda009e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52712/0 (socket says 172.21.15.17:52712) 2024-04-17T02:22:37.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.882+0000 7fed9ffff640 1 --2- 172.21.15.17:0/1783193595 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feda006b370 0x7feda013db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:37.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.882+0000 7feda4eda640 1 -- 172.21.15.17:0/1783193595 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feda006b370 msgr2=0x7feda013db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:37.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.882+0000 7feda4eda640 1 --2- 172.21.15.17:0/1783193595 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feda006b370 0x7feda013db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:37.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.882+0000 7feda4eda640 1 -- 172.21.15.17:0/1783193595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feda00a8270 msgr2=0x7feda009e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:37.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.882+0000 7feda4eda640 1 --2- 172.21.15.17:0/1783193595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feda00a8270 0x7feda009e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:37.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.882+0000 7feda4eda640 1 -- 172.21.15.17:0/1783193595 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda00b74e0 con 0x7feda00a9120 2024-04-17T02:22:37.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.882+0000 7fed97fff640 1 --2- 172.21.15.17:0/1783193595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feda00a8270 0x7feda009e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:37.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.882+0000 7feda4eda640 1 --2- 172.21.15.17:0/1783193595 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7feda00a9120 0x7feda0144e70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fed9802c410 tx=0x7fed98004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:37.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.883+0000 7fed9d7fa640 1 -- 172.21.15.17:0/1783193595 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed98039050 con 0x7feda00a9120 2024-04-17T02:22:37.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.883+0000 7fed9d7fa640 1 -- 172.21.15.17:0/1783193595 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed98045070 con 0x7feda00a9120 2024-04-17T02:22:37.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.883+0000 7fed9d7fa640 1 -- 172.21.15.17:0/1783193595 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed98009450 con 0x7feda00a9120 2024-04-17T02:22:37.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.883+0000 7feda693d640 1 -- 172.21.15.17:0/1783193595 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feda0145ab0 con 0x7feda00a9120 2024-04-17T02:22:37.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.883+0000 7feda693d640 1 -- 172.21.15.17:0/1783193595 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feda0142db0 con 0x7feda00a9120 2024-04-17T02:22:37.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.884+0000 7feda693d640 1 -- 172.21.15.17:0/1783193595 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feda00687f0 con 0x7feda00a9120 2024-04-17T02:22:37.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.885+0000 7fed9d7fa640 1 -- 172.21.15.17:0/1783193595 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7fed9803e850 con 0x7feda00a9120 2024-04-17T02:22:37.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.885+0000 7fed9d7fa640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:37.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.885+0000 7fed9d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:37.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.885+0000 7fed9d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:37.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.885+0000 7fed9d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:37.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.885+0000 7fed9d7fa640 1 --2- 172.21.15.17:0/1783193595 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fed8009f480 0x7fed800a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:37.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.886+0000 7fed9ffff640 1 --2- 172.21.15.17:0/1783193595 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fed8009f480 0x7fed800a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:37.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.886+0000 7fed9d7fa640 1 -- 172.21.15.17:0/1783193595 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7fed980ec190 con 0x7feda00a9120 2024-04-17T02:22:37.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.886+0000 7fed9ffff640 1 --2- 172.21.15.17:0/1783193595 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fed8009f480 0x7fed800a1940 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fed90009560 tx=0x7fed90008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:37.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:37.890+0000 7fed9d7fa640 1 -- 172.21.15.17:0/1783193595 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fed980bb300 con 0x7feda00a9120 2024-04-17T02:22:38.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.069+0000 7feda693d640 1 -- 172.21.15.17:0/1783193595 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7feda0147ec0 con 0x7feda00a9120 2024-04-17T02:22:38.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.069+0000 7fed9d7fa640 1 -- 172.21.15.17:0/1783193595 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fed980bac00 con 0x7feda00a9120 2024-04-17T02:22:38.070 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-04-17T02:22:38.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.071+0000 7feda693d640 10 mgrc shutdown 2024-04-17T02:22:38.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.071+0000 7feda693d640 1 -- 172.21.15.17:0/1783193595 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fed8009f480 msgr2=0x7fed800a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:38.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.071+0000 7feda693d640 1 --2- 172.21.15.17:0/1783193595 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fed8009f480 0x7fed800a1940 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fed90009560 tx=0x7fed90008040 comp rx=0 tx=0).stop 2024-04-17T02:22:38.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.071+0000 7feda693d640 1 -- 172.21.15.17:0/1783193595 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7feda00a9120 msgr2=0x7feda0144e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:38.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.071+0000 7feda693d640 1 --2- 172.21.15.17:0/1783193595 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7feda00a9120 0x7feda0144e70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fed9802c410 tx=0x7fed98004a40 comp rx=0 tx=0).stop 2024-04-17T02:22:38.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.071+0000 7feda693d640 1 -- 172.21.15.17:0/1783193595 shutdown_connections 2024-04-17T02:22:38.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.071+0000 7feda693d640 1 --2- 172.21.15.17:0/1783193595 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fed8009f480 0x7fed800a1940 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:38.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.071+0000 7feda693d640 1 --2- 172.21.15.17:0/1783193595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feda00a8270 0x7feda009e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:38.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.071+0000 7feda693d640 1 --2- 172.21.15.17:0/1783193595 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7feda00a9120 0x7feda0144e70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:38.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.071+0000 7feda693d640 1 --2- 172.21.15.17:0/1783193595 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feda006b370 0x7feda013db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:38.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.071+0000 7feda693d640 1 -- 172.21.15.17:0/1783193595 >> 172.21.15.17:0/1783193595 conn(0x7feda00a6ab0 msgr2=0x7feda006d740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:38.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.071+0000 7feda693d640 1 -- 172.21.15.17:0/1783193595 shutdown_connections 2024-04-17T02:22:38.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.071+0000 7feda693d640 1 -- 172.21.15.17:0/1783193595 wait complete. 2024-04-17T02:22:38.083 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-17T02:22:38.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.188+0000 7f90c4da8640 1 Processor -- start 2024-04-17T02:22:38.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.188+0000 7f90c4da8640 1 -- start start 2024-04-17T02:22:38.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.189+0000 7f90c4da8640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f90c00b8e30 0x7f90c00aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:38.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.189+0000 7f90c4da8640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f90c00a9c00 0x7f90c00aa090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:38.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.189+0000 7f90c4da8640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90c0148870 con 0x7f90c013b540 2024-04-17T02:22:38.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.189+0000 7f90c4da8640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f90c00b9210 con 0x7f90c00b8e30 2024-04-17T02:22:38.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.189+0000 7f90c4da8640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f90c0149660 con 0x7f90c00a9c00 2024-04-17T02:22:38.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.189+0000 7f90be59c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f90c00b8e30 0x7f90c00aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:38.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.189+0000 7f90bdd9b640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f90c013b540 0x7f90c0148f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42104/0 (socket says 172.21.15.17:42104) 2024-04-17T02:22:38.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.189+0000 7f90bdd9b640 1 -- 172.21.15.17:0/1274039124 learned_addr learned my addr 172.21.15.17:0/1274039124 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:22:38.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.189+0000 7f90bed9d640 1 --2- 172.21.15.17:0/1274039124 >> v2:172.21.15.122:3300/0 conn(0x7f90c00a9c00 0x7f90c00aa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:38.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.190+0000 7f90be59c640 1 -- 172.21.15.17:0/1274039124 >> v2:172.21.15.122:3300/0 conn(0x7f90c00a9c00 msgr2=0x7f90c00aa090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:38.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.190+0000 7f90be59c640 1 --2- 172.21.15.17:0/1274039124 >> v2:172.21.15.122:3300/0 conn(0x7f90c00a9c00 0x7f90c00aa090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:38.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.190+0000 7f90be59c640 1 -- 172.21.15.17:0/1274039124 >> v1:172.21.15.17:6789/0 conn(0x7f90c013b540 legacy=0x7f90c0148f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:38.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.190+0000 7f90be59c640 1 -- 172.21.15.17:0/1274039124 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90c013bc90 con 0x7f90c00b8e30 2024-04-17T02:22:38.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.190+0000 7f90bd59a640 1 -- 172.21.15.17:0/1274039124 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3390611684 0 0) 0x7f90c0148870 con 0x7f90c013b540 2024-04-17T02:22:38.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.190+0000 7f90be59c640 1 --2- 172.21.15.17:0/1274039124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90c00b8e30 0x7f90c00aaab0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f90c00aa5d0 tx=0x7f90b802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cde2ef8ca44c74e server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:38.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.190+0000 7f90bd59a640 1 -- 172.21.15.17:0/1274039124 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b80315a0 con 0x7f90c00b8e30 2024-04-17T02:22:38.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.190+0000 7f90bd59a640 1 -- 172.21.15.17:0/1274039124 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90b8037070 con 0x7f90c00b8e30 2024-04-17T02:22:38.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.190+0000 7f90bd59a640 1 -- 172.21.15.17:0/1274039124 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b8031960 con 0x7f90c00b8e30 2024-04-17T02:22:38.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.191+0000 7f90c4da8640 1 -- 172.21.15.17:0/1274039124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90c00b8e30 msgr2=0x7f90c00aaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:38.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.191+0000 7f90c4da8640 1 --2- 172.21.15.17:0/1274039124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90c00b8e30 0x7f90c00aaab0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f90c00aa5d0 tx=0x7f90b802b840 comp rx=0 tx=0).stop 2024-04-17T02:22:38.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.191+0000 7f90c4da8640 1 -- 172.21.15.17:0/1274039124 shutdown_connections 2024-04-17T02:22:38.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.191+0000 7f90c4da8640 1 --2- 172.21.15.17:0/1274039124 >> v2:172.21.15.122:3300/0 conn(0x7f90c00a9c00 0x7f90c00aa090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:38.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.191+0000 7f90c4da8640 1 --2- 172.21.15.17:0/1274039124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90c00b8e30 0x7f90c00aaab0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:38.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.191+0000 7f90c4da8640 1 -- 172.21.15.17:0/1274039124 >> 172.21.15.17:0/1274039124 conn(0x7f90c00741a0 msgr2=0x7f90c00745b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:38.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.191+0000 7f90c4da8640 1 -- 172.21.15.17:0/1274039124 shutdown_connections 2024-04-17T02:22:38.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.191+0000 7f90c4da8640 1 -- 172.21.15.17:0/1274039124 wait complete. 2024-04-17T02:22:38.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.192+0000 7f90c4da8640 1 Processor -- start 2024-04-17T02:22:38.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.192+0000 7f90c4da8640 1 -- start start 2024-04-17T02:22:38.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.193+0000 7f90c4da8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90c00a9c00 0x7f90c0130300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:38.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.193+0000 7f90c4da8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90c00b8e30 0x7f90c013a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:38.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.193+0000 7f90c4da8640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f90c013b540 0x7f90c01de0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:38.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.193+0000 7f90c4da8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f90c014fba0 con 0x7f90c00b8e30 2024-04-17T02:22:38.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.193+0000 7f90c4da8640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f90c014fa20 con 0x7f90c00a9c00 2024-04-17T02:22:38.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.193+0000 7f90c4da8640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f90c014fd20 con 0x7f90c013b540 2024-04-17T02:22:38.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.193+0000 7f90bdd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90c00b8e30 0x7f90c013a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:38.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.193+0000 7f90bed9d640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f90c013b540 0x7f90c01de0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:38.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.193+0000 7f90bdd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90c00b8e30 0x7f90c013a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52726/0 (socket says 172.21.15.17:52726) 2024-04-17T02:22:38.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.193+0000 7f90bdd9b640 1 -- 172.21.15.17:0/2674617781 learned_addr learned my addr 172.21.15.17:0/2674617781 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:38.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.193+0000 7f90be59c640 1 --2- 172.21.15.17:0/2674617781 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90c00a9c00 0x7f90c0130300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:38.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.193+0000 7f90bed9d640 1 -- 172.21.15.17:0/2674617781 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90c00a9c00 msgr2=0x7f90c0130300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:38.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.193+0000 7f90bed9d640 1 --2- 172.21.15.17:0/2674617781 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90c00a9c00 0x7f90c0130300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:38.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.193+0000 7f90bed9d640 1 -- 172.21.15.17:0/2674617781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90c00b8e30 msgr2=0x7f90c013a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:38.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.193+0000 7f90bed9d640 1 --2- 172.21.15.17:0/2674617781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90c00b8e30 0x7f90c013a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:38.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.193+0000 7f90bed9d640 1 -- 172.21.15.17:0/2674617781 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90c0130840 con 0x7f90c013b540 2024-04-17T02:22:38.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.193+0000 7f90bdd9b640 1 --2- 172.21.15.17:0/2674617781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90c00b8e30 0x7f90c013a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:38.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.194+0000 7f90bed9d640 1 --2- 172.21.15.17:0/2674617781 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f90c013b540 0x7f90c01de0f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f90b0007dc0 tx=0x7f90b000e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:38.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.194+0000 7f90b6ffd640 1 -- 172.21.15.17:0/2674617781 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b000edd0 con 0x7f90c013b540 2024-04-17T02:22:38.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.194+0000 7f90b6ffd640 1 -- 172.21.15.17:0/2674617781 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90b0003990 con 0x7f90c013b540 2024-04-17T02:22:38.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.194+0000 7f90c4da8640 1 -- 172.21.15.17:0/2674617781 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90c01dde30 con 0x7f90c013b540 2024-04-17T02:22:38.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.194+0000 7f90b6ffd640 1 -- 172.21.15.17:0/2674617781 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b0003d80 con 0x7f90c013b540 2024-04-17T02:22:38.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.194+0000 7f90c4da8640 1 -- 172.21.15.17:0/2674617781 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f90c012f920 con 0x7f90c013b540 2024-04-17T02:22:38.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.195+0000 7f90c4da8640 1 -- 172.21.15.17:0/2674617781 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90c00687f0 con 0x7f90c013b540 2024-04-17T02:22:38.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.196+0000 7f90b6ffd640 1 -- 172.21.15.17:0/2674617781 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f90b001b020 con 0x7f90c013b540 2024-04-17T02:22:38.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.196+0000 7f90b6ffd640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:38.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.196+0000 7f90b6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:38.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.196+0000 7f90b6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:38.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.196+0000 7f90b6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:38.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.196+0000 7f90b6ffd640 1 --2- 172.21.15.17:0/2674617781 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f90a009f480 0x7f90a00a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:38.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.196+0000 7f90be59c640 1 --2- 172.21.15.17:0/2674617781 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f90a009f480 0x7f90a00a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:38.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.196+0000 7f90b6ffd640 1 -- 172.21.15.17:0/2674617781 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f90b00c95f0 con 0x7f90c013b540 2024-04-17T02:22:38.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.197+0000 7f90be59c640 1 --2- 172.21.15.17:0/2674617781 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f90a009f480 0x7f90a00a1940 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f90b8036000 tx=0x7f90b803d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:38.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.200+0000 7f90b6ffd640 1 -- 172.21.15.17:0/2674617781 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f90b0098650 con 0x7f90c013b540 2024-04-17T02:22:38.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.384+0000 7f90c4da8640 1 -- 172.21.15.17:0/2674617781 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) -- 0x7f90c006d790 con 0x7f90c013b540 2024-04-17T02:22:38.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.384+0000 7f90b6ffd640 1 -- 172.21.15.17:0/2674617781 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) ==== 92+0+10 (secure 0 0 0) 0x7f90b0097f50 con 0x7f90c013b540 2024-04-17T02:22:38.385 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2024-04-17T02:22:38.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.386+0000 7f90c4da8640 10 mgrc shutdown 2024-04-17T02:22:38.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.386+0000 7f90c4da8640 1 -- 172.21.15.17:0/2674617781 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f90a009f480 msgr2=0x7f90a00a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:38.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.386+0000 7f90c4da8640 1 --2- 172.21.15.17:0/2674617781 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f90a009f480 0x7f90a00a1940 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f90b8036000 tx=0x7f90b803d040 comp rx=0 tx=0).stop 2024-04-17T02:22:38.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.386+0000 7f90c4da8640 1 -- 172.21.15.17:0/2674617781 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f90c013b540 msgr2=0x7f90c01de0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:38.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.386+0000 7f90c4da8640 1 --2- 172.21.15.17:0/2674617781 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f90c013b540 0x7f90c01de0f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f90b0007dc0 tx=0x7f90b000e4b0 comp rx=0 tx=0).stop 2024-04-17T02:22:38.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.387+0000 7f90c4da8640 1 -- 172.21.15.17:0/2674617781 shutdown_connections 2024-04-17T02:22:38.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.387+0000 7f90c4da8640 1 --2- 172.21.15.17:0/2674617781 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f90a009f480 0x7f90a00a1940 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:38.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.387+0000 7f90c4da8640 1 --2- 172.21.15.17:0/2674617781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90c00b8e30 0x7f90c013a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:38.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.387+0000 7f90c4da8640 1 --2- 172.21.15.17:0/2674617781 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f90c013b540 0x7f90c01de0f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:38.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.387+0000 7f90c4da8640 1 --2- 172.21.15.17:0/2674617781 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90c00a9c00 0x7f90c0130300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:38.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.387+0000 7f90c4da8640 1 -- 172.21.15.17:0/2674617781 >> 172.21.15.17:0/2674617781 conn(0x7f90c00741a0 msgr2=0x7f90c00b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:38.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.387+0000 7f90c4da8640 1 -- 172.21.15.17:0/2674617781 shutdown_connections 2024-04-17T02:22:38.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.387+0000 7f90c4da8640 1 -- 172.21.15.17:0/2674617781 wait complete. 2024-04-17T02:22:38.399 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T02:22:38.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.505+0000 7fbf3b3d4640 1 Processor -- start 2024-04-17T02:22:38.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.505+0000 7fbf3b3d4640 1 -- start start 2024-04-17T02:22:38.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.506+0000 7fbf3b3d4640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbf340ab5b0 0x7fbf340ac680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:38.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.506+0000 7fbf3b3d4640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fbf34142c90 0x7fbf3414fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:38.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.506+0000 7fbf3b3d4640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf340acea0 con 0x7fbf340bb460 2024-04-17T02:22:38.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.506+0000 7fbf3b3d4640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fbf340ab990 con 0x7fbf340ab5b0 2024-04-17T02:22:38.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.506+0000 7fbf3b3d4640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fbf3406c330 con 0x7fbf34142c90 2024-04-17T02:22:38.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.506+0000 7fbf39170640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbf340ab5b0 0x7fbf340ac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:38.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.506+0000 7fbf39971640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fbf34142c90 0x7fbf3414fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:38.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.506+0000 7fbf39170640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbf340ab5b0 0x7fbf340ac680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52742/0 (socket says 172.21.15.17:52742) 2024-04-17T02:22:38.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.506+0000 7fbf39170640 1 -- 172.21.15.17:0/2813799882 learned_addr learned my addr 172.21.15.17:0/2813799882 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:38.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.506+0000 7fbf39971640 1 -- 172.21.15.17:0/2813799882 >> v2:172.21.15.17:3300/0 conn(0x7fbf340ab5b0 msgr2=0x7fbf340ac680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:38.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.506+0000 7fbf39971640 1 --2- 172.21.15.17:0/2813799882 >> v2:172.21.15.17:3300/0 conn(0x7fbf340ab5b0 0x7fbf340ac680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:38.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.506+0000 7fbf39971640 1 -- 172.21.15.17:0/2813799882 >> v1:172.21.15.122:6789/0 conn(0x7fbf340bb460 legacy=0x7fbf34142580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:38.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.506+0000 7fbf39971640 1 -- 172.21.15.17:0/2813799882 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf340acbc0 con 0x7fbf34142c90 2024-04-17T02:22:38.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.506+0000 7fbf39170640 1 --2- 172.21.15.17:0/2813799882 >> v2:172.21.15.17:3300/0 conn(0x7fbf340ab5b0 0x7fbf340ac680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:38.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.507+0000 7fbf39971640 1 --2- 172.21.15.17:0/2813799882 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fbf34142c90 0x7fbf3414fa90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c009d90 tx=0x7fbf2c02be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab3ef91eb9b15b29 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:38.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.507+0000 7fbf2bfff640 1 -- 172.21.15.17:0/2813799882 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c039070 con 0x7fbf34142c90 2024-04-17T02:22:38.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.507+0000 7fbf2bfff640 1 -- 172.21.15.17:0/2813799882 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf2c02cbc0 con 0x7fbf34142c90 2024-04-17T02:22:38.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.507+0000 7fbf2bfff640 1 -- 172.21.15.17:0/2813799882 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c034440 con 0x7fbf34142c90 2024-04-17T02:22:38.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.508+0000 7fbf3b3d4640 1 -- 172.21.15.17:0/2813799882 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fbf34142c90 msgr2=0x7fbf3414fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:38.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.508+0000 7fbf3b3d4640 1 --2- 172.21.15.17:0/2813799882 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fbf34142c90 0x7fbf3414fa90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c009d90 tx=0x7fbf2c02be10 comp rx=0 tx=0).stop 2024-04-17T02:22:38.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.508+0000 7fbf3b3d4640 1 -- 172.21.15.17:0/2813799882 shutdown_connections 2024-04-17T02:22:38.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.508+0000 7fbf3b3d4640 1 --2- 172.21.15.17:0/2813799882 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fbf34142c90 0x7fbf3414fa90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:38.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.508+0000 7fbf3b3d4640 1 --2- 172.21.15.17:0/2813799882 >> v2:172.21.15.17:3300/0 conn(0x7fbf340ab5b0 0x7fbf340ac680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:38.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.508+0000 7fbf3b3d4640 1 -- 172.21.15.17:0/2813799882 >> 172.21.15.17:0/2813799882 conn(0x7fbf340ba940 msgr2=0x7fbf340bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:38.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.508+0000 7fbf3b3d4640 1 -- 172.21.15.17:0/2813799882 shutdown_connections 2024-04-17T02:22:38.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.508+0000 7fbf3b3d4640 1 -- 172.21.15.17:0/2813799882 wait complete. 2024-04-17T02:22:38.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.509+0000 7fbf3b3d4640 1 Processor -- start 2024-04-17T02:22:38.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.509+0000 7fbf3b3d4640 1 -- start start 2024-04-17T02:22:38.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.509+0000 7fbf3b3d4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbf340ab5b0 0x7fbf340b9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:38.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.509+0000 7fbf3b3d4640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fbf340bb460 0x7fbf3409aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:38.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.509+0000 7fbf3b3d4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf34142c90 0x7fbf34148cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:38.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.509+0000 7fbf3b3d4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbf340a9700 con 0x7fbf34142c90 2024-04-17T02:22:38.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.509+0000 7fbf3b3d4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbf340a7400 con 0x7fbf340ab5b0 2024-04-17T02:22:38.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.509+0000 7fbf3b3d4640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fbf340a9880 con 0x7fbf340bb460 2024-04-17T02:22:38.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.509+0000 7fbf39971640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf34142c90 0x7fbf34148cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:38.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.509+0000 7fbf3896f640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fbf340bb460 0x7fbf3409aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:38.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.509+0000 7fbf39971640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf34142c90 0x7fbf34148cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52754/0 (socket says 172.21.15.17:52754) 2024-04-17T02:22:38.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.509+0000 7fbf3896f640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fbf340bb460 0x7fbf3409aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:53316/0 (socket says 172.21.15.17:53316) 2024-04-17T02:22:38.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.509+0000 7fbf39971640 1 -- 172.21.15.17:0/2928507581 learned_addr learned my addr 172.21.15.17:0/2928507581 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:38.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.510+0000 7fbf39170640 1 --2- 172.21.15.17:0/2928507581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbf340ab5b0 0x7fbf340b9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:38.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.510+0000 7fbf39971640 1 -- 172.21.15.17:0/2928507581 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fbf340bb460 msgr2=0x7fbf3409aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:38.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.510+0000 7fbf39971640 1 --2- 172.21.15.17:0/2928507581 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fbf340bb460 0x7fbf3409aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:38.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.510+0000 7fbf39971640 1 -- 172.21.15.17:0/2928507581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbf340ab5b0 msgr2=0x7fbf340b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:38.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.510+0000 7fbf39971640 1 --2- 172.21.15.17:0/2928507581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbf340ab5b0 0x7fbf340b9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:38.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.510+0000 7fbf39971640 1 -- 172.21.15.17:0/2928507581 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf341ddf40 con 0x7fbf34142c90 2024-04-17T02:22:38.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.510+0000 7fbf3896f640 1 --2- 172.21.15.17:0/2928507581 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fbf340bb460 0x7fbf3409aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:38.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.510+0000 7fbf39971640 1 --2- 172.21.15.17:0/2928507581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf34142c90 0x7fbf34148cd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c009eb0 tx=0x7fbf2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:38.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.510+0000 7fbf29ffb640 1 -- 172.21.15.17:0/2928507581 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c039050 con 0x7fbf34142c90 2024-04-17T02:22:38.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.510+0000 7fbf29ffb640 1 -- 172.21.15.17:0/2928507581 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf2c045070 con 0x7fbf34142c90 2024-04-17T02:22:38.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.510+0000 7fbf3b3d4640 1 -- 172.21.15.17:0/2928507581 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf341de200 con 0x7fbf34142c90 2024-04-17T02:22:38.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.510+0000 7fbf29ffb640 1 -- 172.21.15.17:0/2928507581 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c009450 con 0x7fbf34142c90 2024-04-17T02:22:38.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.510+0000 7fbf3b3d4640 1 -- 172.21.15.17:0/2928507581 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf3409a490 con 0x7fbf34142c90 2024-04-17T02:22:38.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.511+0000 7fbf3b3d4640 1 -- 172.21.15.17:0/2928507581 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf340687f0 con 0x7fbf34142c90 2024-04-17T02:22:38.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.512+0000 7fbf29ffb640 1 -- 172.21.15.17:0/2928507581 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7fbf2c03e830 con 0x7fbf34142c90 2024-04-17T02:22:38.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.512+0000 7fbf29ffb640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:38.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.513+0000 7fbf29ffb640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:38.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.513+0000 7fbf29ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:38.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.513+0000 7fbf29ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:38.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.513+0000 7fbf29ffb640 1 --2- 172.21.15.17:0/2928507581 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fbf1809f4b0 0x7fbf180a1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:38.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.513+0000 7fbf39170640 1 --2- 172.21.15.17:0/2928507581 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fbf1809f4b0 0x7fbf180a1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:38.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.513+0000 7fbf29ffb640 1 -- 172.21.15.17:0/2928507581 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7fbf2c0ecba0 con 0x7fbf34142c90 2024-04-17T02:22:38.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.513+0000 7fbf39170640 1 --2- 172.21.15.17:0/2928507581 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fbf1809f4b0 0x7fbf180a1970 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbf30009b70 tx=0x7fbf30008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:38.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.516+0000 7fbf29ffb640 1 -- 172.21.15.17:0/2928507581 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fbf2c0bbb60 con 0x7fbf34142c90 2024-04-17T02:22:38.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.696+0000 7fbf3b3d4640 1 -- 172.21.15.17:0/2928507581 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fbf340a60c0 con 0x7fbf34142c90 2024-04-17T02:22:38.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.696+0000 7fbf29ffb640 1 -- 172.21.15.17:0/2928507581 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fbf2c0bb460 con 0x7fbf34142c90 2024-04-17T02:22:38.697 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-04-17T02:22:38.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.698+0000 7fbf3b3d4640 10 mgrc shutdown 2024-04-17T02:22:38.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.698+0000 7fbf3b3d4640 1 -- 172.21.15.17:0/2928507581 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fbf1809f4b0 msgr2=0x7fbf180a1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:38.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.698+0000 7fbf3b3d4640 1 --2- 172.21.15.17:0/2928507581 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fbf1809f4b0 0x7fbf180a1970 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbf30009b70 tx=0x7fbf30008040 comp rx=0 tx=0).stop 2024-04-17T02:22:38.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.698+0000 7fbf3b3d4640 1 -- 172.21.15.17:0/2928507581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf34142c90 msgr2=0x7fbf34148cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:38.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.698+0000 7fbf3b3d4640 1 --2- 172.21.15.17:0/2928507581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf34142c90 0x7fbf34148cd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c009eb0 tx=0x7fbf2c004a40 comp rx=0 tx=0).stop 2024-04-17T02:22:38.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.698+0000 7fbf3b3d4640 1 -- 172.21.15.17:0/2928507581 shutdown_connections 2024-04-17T02:22:38.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.698+0000 7fbf3b3d4640 1 --2- 172.21.15.17:0/2928507581 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fbf1809f4b0 0x7fbf180a1970 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:38.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.698+0000 7fbf3b3d4640 1 --2- 172.21.15.17:0/2928507581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf34142c90 0x7fbf34148cd0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:38.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.698+0000 7fbf3b3d4640 1 --2- 172.21.15.17:0/2928507581 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fbf340bb460 0x7fbf3409aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:38.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.698+0000 7fbf3b3d4640 1 --2- 172.21.15.17:0/2928507581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbf340ab5b0 0x7fbf340b9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:38.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.698+0000 7fbf3b3d4640 1 -- 172.21.15.17:0/2928507581 >> 172.21.15.17:0/2928507581 conn(0x7fbf340ba940 msgr2=0x7fbf3413e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:38.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.698+0000 7fbf3b3d4640 1 -- 172.21.15.17:0/2928507581 shutdown_connections 2024-04-17T02:22:38.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.698+0000 7fbf3b3d4640 1 -- 172.21.15.17:0/2928507581 wait complete. 2024-04-17T02:22:38.710 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T02:22:38.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.816+0000 7f99f6704640 1 Processor -- start 2024-04-17T02:22:38.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.816+0000 7f99f6704640 1 -- start start 2024-04-17T02:22:38.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.817+0000 7f99f6704640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f99f013b540 0x7f99f0148f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:38.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.817+0000 7f99f6704640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f99f00a9c00 0x7f99f00aa090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:38.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.817+0000 7f99f6704640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99f0148870 con 0x7f99f00b8e30 2024-04-17T02:22:38.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.817+0000 7f99f6704640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f99f00b9210 con 0x7f99f00a9c00 2024-04-17T02:22:38.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.817+0000 7f99f6704640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f99f013bc90 con 0x7f99f013b540 2024-04-17T02:22:38.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.817+0000 7f99f4ca1640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f99f00a9c00 0x7f99f00aa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:38.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.817+0000 7f99f4ca1640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f99f00a9c00 0x7f99f00aa090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52760/0 (socket says 172.21.15.17:52760) 2024-04-17T02:22:38.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.817+0000 7f99f4ca1640 1 -- 172.21.15.17:0/558125788 learned_addr learned my addr 172.21.15.17:0/558125788 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:38.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.817+0000 7f99e7fff640 1 --2- 172.21.15.17:0/558125788 >> v2:172.21.15.122:3300/0 conn(0x7f99f013b540 0x7f99f0148f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:38.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.817+0000 7f99f4ca1640 1 -- 172.21.15.17:0/558125788 >> v2:172.21.15.122:3300/0 conn(0x7f99f013b540 msgr2=0x7f99f0148f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:38.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.817+0000 7f99f4ca1640 1 --2- 172.21.15.17:0/558125788 >> v2:172.21.15.122:3300/0 conn(0x7f99f013b540 0x7f99f0148f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:38.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.817+0000 7f99f4ca1640 1 -- 172.21.15.17:0/558125788 >> v1:172.21.15.122:6789/0 conn(0x7f99f00b8e30 legacy=0x7f99f00aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:38.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.817+0000 7f99f4ca1640 1 -- 172.21.15.17:0/558125788 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99f0149490 con 0x7f99f00a9c00 2024-04-17T02:22:38.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.818+0000 7f99f4ca1640 1 --2- 172.21.15.17:0/558125788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99f00a9c00 0x7f99f00aa090 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f99f00b9a10 tx=0x7f99e802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b721d90b41dcaa9 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:38.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.818+0000 7f99ef7fe640 1 -- 172.21.15.17:0/558125788 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e802ca80 con 0x7f99f00a9c00 2024-04-17T02:22:38.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.818+0000 7f99ef7fe640 1 -- 172.21.15.17:0/558125788 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99e802cc20 con 0x7f99f00a9c00 2024-04-17T02:22:38.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.818+0000 7f99ef7fe640 1 -- 172.21.15.17:0/558125788 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e80343f0 con 0x7f99f00a9c00 2024-04-17T02:22:38.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.819+0000 7f99f6704640 1 -- 172.21.15.17:0/558125788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99f00a9c00 msgr2=0x7f99f00aa090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:38.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.819+0000 7f99f6704640 1 --2- 172.21.15.17:0/558125788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99f00a9c00 0x7f99f00aa090 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f99f00b9a10 tx=0x7f99e802bee0 comp rx=0 tx=0).stop 2024-04-17T02:22:38.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.819+0000 7f99f6704640 1 -- 172.21.15.17:0/558125788 shutdown_connections 2024-04-17T02:22:38.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.819+0000 7f99f6704640 1 --2- 172.21.15.17:0/558125788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99f00a9c00 0x7f99f00aa090 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:38.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.819+0000 7f99f6704640 1 --2- 172.21.15.17:0/558125788 >> v2:172.21.15.122:3300/0 conn(0x7f99f013b540 0x7f99f0148f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:38.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.819+0000 7f99f6704640 1 -- 172.21.15.17:0/558125788 >> 172.21.15.17:0/558125788 conn(0x7f99f00741a0 msgr2=0x7f99f00745b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:38.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.819+0000 7f99f6704640 1 -- 172.21.15.17:0/558125788 shutdown_connections 2024-04-17T02:22:38.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.819+0000 7f99f6704640 1 -- 172.21.15.17:0/558125788 wait complete. 2024-04-17T02:22:38.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.820+0000 7f99f6704640 1 Processor -- start 2024-04-17T02:22:38.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.820+0000 7f99f6704640 1 -- start start 2024-04-17T02:22:38.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.820+0000 7f99f6704640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f99f00a9c00 0x7f99f01499e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:38.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.820+0000 7f99f6704640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99f00b8e30 0x7f99f014ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:38.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.820+0000 7f99f6704640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99f013b540 0x7f99f01ddf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:38.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.820+0000 7f99f6704640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f99f014fdb0 con 0x7f99f013b540 2024-04-17T02:22:38.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.820+0000 7f99f6704640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f99f014fc30 con 0x7f99f00b8e30 2024-04-17T02:22:38.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.820+0000 7f99f6704640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f99f014ff30 con 0x7f99f00a9c00 2024-04-17T02:22:38.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.821+0000 7f99effff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f99f00a9c00 0x7f99f01499e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:38.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.821+0000 7f99f4ca1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99f013b540 0x7f99f01ddf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:38.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.821+0000 7f99effff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f99f00a9c00 0x7f99f01499e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:53322/0 (socket says 172.21.15.17:53322) 2024-04-17T02:22:38.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.821+0000 7f99effff640 1 -- 172.21.15.17:0/764259734 learned_addr learned my addr 172.21.15.17:0/764259734 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:38.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.821+0000 7f99e7fff640 1 --2- 172.21.15.17:0/764259734 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99f00b8e30 0x7f99f014ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:38.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.821+0000 7f99f4ca1640 1 -- 172.21.15.17:0/764259734 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f99f00a9c00 msgr2=0x7f99f01499e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:38.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.821+0000 7f99f4ca1640 1 --2- 172.21.15.17:0/764259734 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f99f00a9c00 0x7f99f01499e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:38.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.821+0000 7f99f4ca1640 1 -- 172.21.15.17:0/764259734 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99f00b8e30 msgr2=0x7f99f014ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:38.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.821+0000 7f99f4ca1640 1 --2- 172.21.15.17:0/764259734 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99f00b8e30 0x7f99f014ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:38.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.821+0000 7f99f4ca1640 1 -- 172.21.15.17:0/764259734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99f006e190 con 0x7f99f013b540 2024-04-17T02:22:38.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.821+0000 7f99f4ca1640 1 --2- 172.21.15.17:0/764259734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99f013b540 0x7f99f01ddf30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f99f0148a40 tx=0x7f99e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:38.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.821+0000 7f99ed7fa640 1 -- 172.21.15.17:0/764259734 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e8043020 con 0x7f99f013b540 2024-04-17T02:22:38.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.821+0000 7f99ed7fa640 1 -- 172.21.15.17:0/764259734 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99e803e450 con 0x7f99f013b540 2024-04-17T02:22:38.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.821+0000 7f99f6704640 1 -- 172.21.15.17:0/764259734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99f0145ce0 con 0x7f99f013b540 2024-04-17T02:22:38.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.821+0000 7f99ed7fa640 1 -- 172.21.15.17:0/764259734 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e8009510 con 0x7f99f013b540 2024-04-17T02:22:38.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.821+0000 7f99f6704640 1 -- 172.21.15.17:0/764259734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99f0138030 con 0x7f99f013b540 2024-04-17T02:22:38.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.822+0000 7f99f6704640 1 -- 172.21.15.17:0/764259734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99f00687f0 con 0x7f99f013b540 2024-04-17T02:22:38.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.823+0000 7f99ed7fa640 1 -- 172.21.15.17:0/764259734 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f99e8046020 con 0x7f99f013b540 2024-04-17T02:22:38.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.823+0000 7f99ed7fa640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:38.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.824+0000 7f99ed7fa640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:38.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.824+0000 7f99ed7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:38.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.824+0000 7f99ed7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:38.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.824+0000 7f99ed7fa640 1 --2- 172.21.15.17:0/764259734 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f99d009f480 0x7f99d00a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:38.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.824+0000 7f99effff640 1 --2- 172.21.15.17:0/764259734 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f99d009f480 0x7f99d00a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:38.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.824+0000 7f99ed7fa640 1 -- 172.21.15.17:0/764259734 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f99e80ebb20 con 0x7f99f013b540 2024-04-17T02:22:38.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.824+0000 7f99effff640 1 --2- 172.21.15.17:0/764259734 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f99d009f480 0x7f99d00a1940 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f99e0001840 tx=0x7f99e0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:38.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:38.828+0000 7f99ed7fa640 1 -- 172.21.15.17:0/764259734 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f99e804d030 con 0x7f99f013b540 2024-04-17T02:22:39.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.007+0000 7f99f6704640 1 -- 172.21.15.17:0/764259734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f99f00b8320 con 0x7f99f013b540 2024-04-17T02:22:39.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.007+0000 7f99ed7fa640 1 -- 172.21.15.17:0/764259734 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f99e80bab80 con 0x7f99f013b540 2024-04-17T02:22:39.009 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-04-17T02:22:39.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.009+0000 7f99f6704640 10 mgrc shutdown 2024-04-17T02:22:39.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.009+0000 7f99f6704640 1 -- 172.21.15.17:0/764259734 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f99d009f480 msgr2=0x7f99d00a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:39.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.009+0000 7f99f6704640 1 --2- 172.21.15.17:0/764259734 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f99d009f480 0x7f99d00a1940 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f99e0001840 tx=0x7f99e0009040 comp rx=0 tx=0).stop 2024-04-17T02:22:39.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.009+0000 7f99f6704640 1 -- 172.21.15.17:0/764259734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99f013b540 msgr2=0x7f99f01ddf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:39.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.009+0000 7f99f6704640 1 --2- 172.21.15.17:0/764259734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99f013b540 0x7f99f01ddf30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f99f0148a40 tx=0x7f99e8004a40 comp rx=0 tx=0).stop 2024-04-17T02:22:39.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.009+0000 7f99f6704640 1 -- 172.21.15.17:0/764259734 shutdown_connections 2024-04-17T02:22:39.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.009+0000 7f99f6704640 1 --2- 172.21.15.17:0/764259734 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f99d009f480 0x7f99d00a1940 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:39.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.009+0000 7f99f6704640 1 --2- 172.21.15.17:0/764259734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99f013b540 0x7f99f01ddf30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:39.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.009+0000 7f99f6704640 1 --2- 172.21.15.17:0/764259734 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99f00b8e30 0x7f99f014ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:39.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.009+0000 7f99f6704640 1 --2- 172.21.15.17:0/764259734 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f99f00a9c00 0x7f99f01499e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:39.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.009+0000 7f99f6704640 1 -- 172.21.15.17:0/764259734 >> 172.21.15.17:0/764259734 conn(0x7f99f00741a0 msgr2=0x7f99f0072220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:39.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.009+0000 7f99f6704640 1 -- 172.21.15.17:0/764259734 shutdown_connections 2024-04-17T02:22:39.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.009+0000 7f99f6704640 1 -- 172.21.15.17:0/764259734 wait complete. 2024-04-17T02:22:39.022 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T02:22:39.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.125+0000 7f5728508640 1 Processor -- start 2024-04-17T02:22:39.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.125+0000 7f5728508640 1 -- start start 2024-04-17T02:22:39.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.126+0000 7f5728508640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f57200bb460 0x7f5720142580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:39.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.126+0000 7f5728508640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57200acea0 con 0x7f57200ab5b0 2024-04-17T02:22:39.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.126+0000 7f5728508640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f572006dd30 con 0x7f5720142ac0 2024-04-17T02:22:39.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.126+0000 7f5728508640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f57200ab990 con 0x7f57200bb460 2024-04-17T02:22:39.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.126+0000 7f5725aa3640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f57200bb460 0x7f5720142580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:39.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.126+0000 7f57262a4640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f57200ab5b0 0x7f57200ac680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42106/0 (socket says 172.21.15.17:42106) 2024-04-17T02:22:39.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.126+0000 7f57262a4640 1 -- 172.21.15.17:0/2282688961 learned_addr learned my addr 172.21.15.17:0/2282688961 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:22:39.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.127+0000 7f5725aa3640 1 -- 172.21.15.17:0/2282688961 >> v1:172.21.15.122:6789/0 conn(0x7f5720142ac0 legacy=0x7f572014fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:39.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.127+0000 7f57252a2640 1 -- 172.21.15.17:0/2282688961 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2861094183 0 0) 0x7f57200acea0 con 0x7f57200ab5b0 2024-04-17T02:22:39.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.127+0000 7f5725aa3640 1 -- 172.21.15.17:0/2282688961 >> v1:172.21.15.17:6789/0 conn(0x7f57200ab5b0 legacy=0x7f57200ac680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:39.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.127+0000 7f5725aa3640 1 -- 172.21.15.17:0/2282688961 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57200a7400 con 0x7f57200bb460 2024-04-17T02:22:39.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.127+0000 7f5725aa3640 1 --2- 172.21.15.17:0/2282688961 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f57200bb460 0x7f5720142580 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f57100097d0 tx=0x7f571002b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddbe57837fd10a74 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:39.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.128+0000 7f57252a2640 1 -- 172.21.15.17:0/2282688961 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5710035020 con 0x7f57200bb460 2024-04-17T02:22:39.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.128+0000 7f57252a2640 1 -- 172.21.15.17:0/2282688961 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5710031800 con 0x7f57200bb460 2024-04-17T02:22:39.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.128+0000 7f57252a2640 1 -- 172.21.15.17:0/2282688961 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5710031bd0 con 0x7f57200bb460 2024-04-17T02:22:39.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.128+0000 7f5728508640 1 -- 172.21.15.17:0/2282688961 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f57200bb460 msgr2=0x7f5720142580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:39.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.128+0000 7f5728508640 1 --2- 172.21.15.17:0/2282688961 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f57200bb460 0x7f5720142580 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f57100097d0 tx=0x7f571002b8a0 comp rx=0 tx=0).stop 2024-04-17T02:22:39.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.128+0000 7f5728508640 1 -- 172.21.15.17:0/2282688961 shutdown_connections 2024-04-17T02:22:39.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.128+0000 7f5728508640 1 --2- 172.21.15.17:0/2282688961 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f57200bb460 0x7f5720142580 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:39.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.128+0000 7f5728508640 1 -- 172.21.15.17:0/2282688961 >> 172.21.15.17:0/2282688961 conn(0x7f57200ba940 msgr2=0x7f57200bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:39.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.128+0000 7f5728508640 1 -- 172.21.15.17:0/2282688961 shutdown_connections 2024-04-17T02:22:39.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.128+0000 7f5728508640 1 -- 172.21.15.17:0/2282688961 wait complete. 2024-04-17T02:22:39.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.129+0000 7f5728508640 1 Processor -- start 2024-04-17T02:22:39.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.129+0000 7f5728508640 1 -- start start 2024-04-17T02:22:39.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.130+0000 7f5728508640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57200ab5b0 0x7f57200b9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:39.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.130+0000 7f5728508640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f57200bb460 0x7f5720147180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:39.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.130+0000 7f5728508640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f5720142ac0 0x7f57201430d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:39.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.130+0000 7f5728508640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f57201511b0 con 0x7f57200ab5b0 2024-04-17T02:22:39.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.130+0000 7f5728508640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5720151330 con 0x7f57200bb460 2024-04-17T02:22:39.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.130+0000 7f5728508640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f57201514b0 con 0x7f5720142ac0 2024-04-17T02:22:39.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.130+0000 7f57262a4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57200ab5b0 0x7f57200b9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:39.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.130+0000 7f5726aa5640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f5720142ac0 0x7f57201430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:39.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.130+0000 7f57262a4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57200ab5b0 0x7f57200b9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52770/0 (socket says 172.21.15.17:52770) 2024-04-17T02:22:39.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.130+0000 7f5726aa5640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f5720142ac0 0x7f57201430d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:53342/0 (socket says 172.21.15.17:53342) 2024-04-17T02:22:39.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.130+0000 7f57262a4640 1 -- 172.21.15.17:0/4067020989 learned_addr learned my addr 172.21.15.17:0/4067020989 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:39.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.130+0000 7f5725aa3640 1 --2- 172.21.15.17:0/4067020989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f57200bb460 0x7f5720147180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:39.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.130+0000 7f57262a4640 1 -- 172.21.15.17:0/4067020989 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f5720142ac0 msgr2=0x7f57201430d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:39.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.130+0000 7f57262a4640 1 --2- 172.21.15.17:0/4067020989 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f5720142ac0 0x7f57201430d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:39.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.130+0000 7f57262a4640 1 -- 172.21.15.17:0/4067020989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f57200bb460 msgr2=0x7f5720147180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:39.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.130+0000 7f57262a4640 1 --2- 172.21.15.17:0/4067020989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f57200bb460 0x7f5720147180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:39.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.130+0000 7f57262a4640 1 -- 172.21.15.17:0/4067020989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5720148270 con 0x7f57200ab5b0 2024-04-17T02:22:39.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.130+0000 7f5726aa5640 1 --2- 172.21.15.17:0/4067020989 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f5720142ac0 0x7f57201430d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:39.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.130+0000 7f57262a4640 1 --2- 172.21.15.17:0/4067020989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57200ab5b0 0x7f57200b9a70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f571c00c500 tx=0x7f571c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:39.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.131+0000 7f5716ffd640 1 -- 172.21.15.17:0/4067020989 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f571c018070 con 0x7f57200ab5b0 2024-04-17T02:22:39.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.131+0000 7f5716ffd640 1 -- 172.21.15.17:0/4067020989 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f571c007580 con 0x7f57200ab5b0 2024-04-17T02:22:39.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.131+0000 7f5728508640 1 -- 172.21.15.17:0/4067020989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57200ba6c0 con 0x7f57200ab5b0 2024-04-17T02:22:39.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.131+0000 7f5716ffd640 1 -- 172.21.15.17:0/4067020989 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f571c004a20 con 0x7f57200ab5b0 2024-04-17T02:22:39.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.131+0000 7f5728508640 1 -- 172.21.15.17:0/4067020989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f572009ef00 con 0x7f57200ab5b0 2024-04-17T02:22:39.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.132+0000 7f5728508640 1 -- 172.21.15.17:0/4067020989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57200687f0 con 0x7f57200ab5b0 2024-04-17T02:22:39.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.133+0000 7f5716ffd640 1 -- 172.21.15.17:0/4067020989 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f571c01b070 con 0x7f57200ab5b0 2024-04-17T02:22:39.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.133+0000 7f5716ffd640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:39.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.133+0000 7f5716ffd640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:39.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.133+0000 7f5716ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:39.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.133+0000 7f5716ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:39.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.133+0000 7f5716ffd640 1 --2- 172.21.15.17:0/4067020989 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f570409f480 0x7f57040a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:39.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.133+0000 7f5725aa3640 1 --2- 172.21.15.17:0/4067020989 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f570409f480 0x7f57040a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:39.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.133+0000 7f5716ffd640 1 -- 172.21.15.17:0/4067020989 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f571c0c89f0 con 0x7f57200ab5b0 2024-04-17T02:22:39.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.134+0000 7f5725aa3640 1 --2- 172.21.15.17:0/4067020989 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f570409f480 0x7f57040a1940 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5710036000 tx=0x7f571003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:39.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.137+0000 7f5716ffd640 1 -- 172.21.15.17:0/4067020989 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f571c097ae0 con 0x7f57200ab5b0 2024-04-17T02:22:39.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.356+0000 7f5728508640 1 -- 172.21.15.17:0/4067020989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f57200ba170 con 0x7f57200ab5b0 2024-04-17T02:22:39.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.356+0000 7f5716ffd640 1 -- 172.21.15.17:0/4067020989 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4348 (secure 0 0 0) 0x7f571c0b4e20 con 0x7f57200ab5b0 2024-04-17T02:22:39.357 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:22:39.358 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4228,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6813/1946927344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6811","nonce":1946927344},{"type":"v1","addr":"172.21.15.17:6813","nonce":1946927344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4234,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6825/529920036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":529920036},{"type":"v1","addr":"172.21.15.122:6825","nonce":529920036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T02:22:21.611698+0000","modified":"2024-04-17T02:22:23.609137+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6812/356803728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":356803728},{"type":"v1","addr":"172.21.15.17:6812","nonce":356803728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4254,"qdb_cluster":[4254]},"id":1}]} 2024-04-17T02:22:39.358 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 6 2024-04-17T02:22:39.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.358+0000 7f5728508640 10 mgrc shutdown 2024-04-17T02:22:39.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.358+0000 7f5728508640 1 -- 172.21.15.17:0/4067020989 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f570409f480 msgr2=0x7f57040a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:39.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.359+0000 7f5728508640 1 --2- 172.21.15.17:0/4067020989 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f570409f480 0x7f57040a1940 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5710036000 tx=0x7f571003c040 comp rx=0 tx=0).stop 2024-04-17T02:22:39.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.359+0000 7f5728508640 1 -- 172.21.15.17:0/4067020989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57200ab5b0 msgr2=0x7f57200b9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:39.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.359+0000 7f5728508640 1 --2- 172.21.15.17:0/4067020989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57200ab5b0 0x7f57200b9a70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f571c00c500 tx=0x7f571c00c9c0 comp rx=0 tx=0).stop 2024-04-17T02:22:39.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.359+0000 7f5728508640 1 -- 172.21.15.17:0/4067020989 shutdown_connections 2024-04-17T02:22:39.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.359+0000 7f5728508640 1 --2- 172.21.15.17:0/4067020989 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f570409f480 0x7f57040a1940 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:39.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.359+0000 7f5728508640 1 --2- 172.21.15.17:0/4067020989 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f5720142ac0 0x7f57201430d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:39.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.359+0000 7f5728508640 1 --2- 172.21.15.17:0/4067020989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f57200bb460 0x7f5720147180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:39.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.359+0000 7f5728508640 1 --2- 172.21.15.17:0/4067020989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57200ab5b0 0x7f57200b9a70 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:39.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.359+0000 7f5728508640 1 -- 172.21.15.17:0/4067020989 >> 172.21.15.17:0/4067020989 conn(0x7f57200ba940 msgr2=0x7f57200a7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:39.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.359+0000 7f5728508640 1 -- 172.21.15.17:0/4067020989 shutdown_connections 2024-04-17T02:22:39.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.359+0000 7f5728508640 1 -- 172.21.15.17:0/4067020989 wait complete. 2024-04-17T02:22:39.371 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T02:22:39.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.476+0000 7f9449a38640 1 Processor -- start 2024-04-17T02:22:39.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.476+0000 7f9449a38640 1 -- start start 2024-04-17T02:22:39.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.477+0000 7f9449a38640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f94440bb460 0x7f9444142580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:39.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.477+0000 7f9449a38640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94440acea0 con 0x7f94440ab5b0 2024-04-17T02:22:39.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.477+0000 7f9449a38640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f944406dd30 con 0x7f9444142ac0 2024-04-17T02:22:39.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.477+0000 7f9449a38640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f94440ab990 con 0x7f94440bb460 2024-04-17T02:22:39.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.477+0000 7f9442ffd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f94440ab5b0 0x7f94440ac680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42120/0 (socket says 172.21.15.17:42120) 2024-04-17T02:22:39.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.477+0000 7f94427fc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f94440bb460 0x7f9444142580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:39.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.477+0000 7f9442ffd640 1 -- 172.21.15.17:0/1826657507 learned_addr learned my addr 172.21.15.17:0/1826657507 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:22:39.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.477+0000 7f94427fc640 1 -- 172.21.15.17:0/1826657507 >> v1:172.21.15.122:6789/0 conn(0x7f9444142ac0 legacy=0x7f944414fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:39.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.477+0000 7f94427fc640 1 -- 172.21.15.17:0/1826657507 >> v1:172.21.15.17:6789/0 conn(0x7f94440ab5b0 legacy=0x7f94440ac680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:39.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.477+0000 7f94427fc640 1 -- 172.21.15.17:0/1826657507 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94440a7400 con 0x7f94440bb460 2024-04-17T02:22:39.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.478+0000 7f94427fc640 1 --2- 172.21.15.17:0/1826657507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94440bb460 0x7f9444142580 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f942c0097a0 tx=0x7f942c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e2db26bfbac2f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:39.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.478+0000 7f9441ffb640 1 -- 172.21.15.17:0/1826657507 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942c035020 con 0x7f94440bb460 2024-04-17T02:22:39.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.478+0000 7f9441ffb640 1 -- 172.21.15.17:0/1826657507 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f942c031830 con 0x7f94440bb460 2024-04-17T02:22:39.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.478+0000 7f9441ffb640 1 -- 172.21.15.17:0/1826657507 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942c031c00 con 0x7f94440bb460 2024-04-17T02:22:39.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.479+0000 7f9449a38640 1 -- 172.21.15.17:0/1826657507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94440bb460 msgr2=0x7f9444142580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:39.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.479+0000 7f9449a38640 1 --2- 172.21.15.17:0/1826657507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94440bb460 0x7f9444142580 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f942c0097a0 tx=0x7f942c02b8d0 comp rx=0 tx=0).stop 2024-04-17T02:22:39.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.479+0000 7f9449a38640 1 -- 172.21.15.17:0/1826657507 shutdown_connections 2024-04-17T02:22:39.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.479+0000 7f9449a38640 1 --2- 172.21.15.17:0/1826657507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94440bb460 0x7f9444142580 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:39.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.479+0000 7f9449a38640 1 -- 172.21.15.17:0/1826657507 >> 172.21.15.17:0/1826657507 conn(0x7f94440ba940 msgr2=0x7f94440bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:39.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.479+0000 7f9449a38640 1 -- 172.21.15.17:0/1826657507 shutdown_connections 2024-04-17T02:22:39.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.479+0000 7f9449a38640 1 -- 172.21.15.17:0/1826657507 wait complete. 2024-04-17T02:22:39.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.480+0000 7f9449a38640 1 Processor -- start 2024-04-17T02:22:39.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.480+0000 7f9449a38640 1 -- start start 2024-04-17T02:22:39.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.480+0000 7f9449a38640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94440ab5b0 0x7f9444145d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:39.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.480+0000 7f9449a38640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94440bb460 0x7f94440b9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:39.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.480+0000 7f9449a38640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9444142ac0 0x7f944414ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:39.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.480+0000 7f9449a38640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f94441511b0 con 0x7f94440bb460 2024-04-17T02:22:39.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.480+0000 7f9449a38640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9444151330 con 0x7f94440ab5b0 2024-04-17T02:22:39.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.480+0000 7f9449a38640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f94441514b0 con 0x7f9444142ac0 2024-04-17T02:22:39.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.480+0000 7f94427fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94440bb460 0x7f94440b9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:39.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.480+0000 7f94427fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94440bb460 0x7f94440b9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52780/0 (socket says 172.21.15.17:52780) 2024-04-17T02:22:39.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.480+0000 7f94427fc640 1 -- 172.21.15.17:0/1825136041 learned_addr learned my addr 172.21.15.17:0/1825136041 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:39.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.480+0000 7f94437fe640 1 --2- 172.21.15.17:0/1825136041 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9444142ac0 0x7f944414ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:39.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.481+0000 7f9442ffd640 1 --2- 172.21.15.17:0/1825136041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94440ab5b0 0x7f9444145d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:39.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.481+0000 7f94427fc640 1 -- 172.21.15.17:0/1825136041 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9444142ac0 msgr2=0x7f944414ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:39.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.481+0000 7f94427fc640 1 --2- 172.21.15.17:0/1825136041 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9444142ac0 0x7f944414ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:39.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.481+0000 7f94427fc640 1 -- 172.21.15.17:0/1825136041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94440ab5b0 msgr2=0x7f9444145d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:39.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.481+0000 7f94427fc640 1 --2- 172.21.15.17:0/1825136041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94440ab5b0 0x7f9444145d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:39.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.481+0000 7f94427fc640 1 -- 172.21.15.17:0/1825136041 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94441455f0 con 0x7f94440bb460 2024-04-17T02:22:39.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.481+0000 7f94437fe640 1 --2- 172.21.15.17:0/1825136041 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9444142ac0 0x7f944414ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:39.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.481+0000 7f94427fc640 1 --2- 172.21.15.17:0/1825136041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94440bb460 0x7f94440b9c70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f942c02bee0 tx=0x7f942c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:39.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.481+0000 7f943bfff640 1 -- 172.21.15.17:0/1825136041 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942c041070 con 0x7f94440bb460 2024-04-17T02:22:39.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.481+0000 7f943bfff640 1 -- 172.21.15.17:0/1825136041 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f942c03aa30 con 0x7f94440bb460 2024-04-17T02:22:39.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.481+0000 7f943bfff640 1 -- 172.21.15.17:0/1825136041 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942c035040 con 0x7f94440bb460 2024-04-17T02:22:39.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.481+0000 7f9449a38640 1 -- 172.21.15.17:0/1825136041 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9444143170 con 0x7f94440bb460 2024-04-17T02:22:39.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.481+0000 7f9449a38640 1 -- 172.21.15.17:0/1825136041 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9444142810 con 0x7f94440bb460 2024-04-17T02:22:39.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.482+0000 7f9449a38640 1 -- 172.21.15.17:0/1825136041 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94440687f0 con 0x7f94440bb460 2024-04-17T02:22:39.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.483+0000 7f943bfff640 1 -- 172.21.15.17:0/1825136041 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f942c038020 con 0x7f94440bb460 2024-04-17T02:22:39.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.483+0000 7f943bfff640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:39.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.484+0000 7f943bfff640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:39.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.484+0000 7f943bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:39.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.484+0000 7f943bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:39.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.484+0000 7f943bfff640 1 --2- 172.21.15.17:0/1825136041 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f942409f480 0x7f94240a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:39.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.484+0000 7f9442ffd640 1 --2- 172.21.15.17:0/1825136041 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f942409f480 0x7f94240a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:39.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.484+0000 7f943bfff640 1 -- 172.21.15.17:0/1825136041 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f942c0eaf90 con 0x7f94440bb460 2024-04-17T02:22:39.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.484+0000 7f9442ffd640 1 --2- 172.21.15.17:0/1825136041 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f942409f480 0x7f94240a1940 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f943c000f60 tx=0x7f943c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:39.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.488+0000 7f943bfff640 1 -- 172.21.15.17:0/1825136041 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f9444143170 con 0x7f94440bb460 2024-04-17T02:22:39.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.674+0000 7f9449a38640 1 -- 172.21.15.17:0/1825136041 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f944414feb0 con 0x7f94440bb460 2024-04-17T02:22:39.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.675+0000 7f943bfff640 1 -- 172.21.15.17:0/1825136041 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+13561 (secure 0 0 0) 0x7f942c0b9ff0 con 0x7f94440bb460 2024-04-17T02:22:39.677 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:22:39.677 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":20,"fsid":"7cbfae20-b10d-41da-92b7-cbd5c1632e23","created":"2024-04-17T02:22:00.246446+0000","modified":"2024-04-17T02:22:23.241120+0000","last_up_change":"2024-04-17T02:22:09.077928+0000","last_in_change":"2024-04-17T02:22:01.415384+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T02:22:10.533377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-17T02:22:15.947495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-17T02:22:20.016616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-17T02:22:20.573938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2973665c-6c5e-4688-bffe-72d3bdcf467f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6801","nonce":1828284343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6803","nonce":1828284343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6807","nonce":1828284343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6805","nonce":1828284343}]},"public_addr":"172.21.15.17:6801/1828284343","cluster_addr":"172.21.15.17:6803/1828284343","heartbeat_back_addr":"172.21.15.17:6807/1828284343","heartbeat_front_addr":"172.21.15.17:6805/1828284343","state":["exists","up"]},{"osd":1,"uuid":"a59a034d-19b4-47e8-8ca5-538597b4af1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6809","nonce":2064593011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6811","nonce":2064593011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6815","nonce":2064593011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6813","nonce":2064593011}]},"public_addr":"172.21.15.122:6809/2064593011","cluster_addr":"172.21.15.122:6811/2064593011","heartbeat_back_addr":"172.21.15.122:6815/2064593011","heartbeat_front_addr":"172.21.15.122:6813/2064593011","state":["exists","up"]},{"osd":2,"uuid":"070f4c5f-459f-46ff-b980-05b1ac50c951","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6817","nonce":929092547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6819","nonce":929092547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6823","nonce":929092547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6821","nonce":929092547}]},"public_addr":"172.21.15.122:6817/929092547","cluster_addr":"172.21.15.122:6819/929092547","heartbeat_back_addr":"172.21.15.122:6823/929092547","heartbeat_front_addr":"172.21.15.122:6821/929092547","state":["exists","up"]},{"osd":3,"uuid":"96216a49-a7b6-40eb-bc93-cc8c78a5270a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6801","nonce":204132523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6803","nonce":204132523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6807","nonce":204132523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6805","nonce":204132523}]},"public_addr":"172.21.15.122:6801/204132523","cluster_addr":"172.21.15.122:6803/204132523","heartbeat_back_addr":"172.21.15.122:6807/204132523","heartbeat_front_addr":"172.21.15.122:6805/204132523","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.477173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.522791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.590625+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.480698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T02:22:39.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.678+0000 7f9449a38640 10 mgrc shutdown 2024-04-17T02:22:39.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.678+0000 7f9449a38640 1 -- 172.21.15.17:0/1825136041 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f942409f480 msgr2=0x7f94240a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:39.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.678+0000 7f9449a38640 1 --2- 172.21.15.17:0/1825136041 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f942409f480 0x7f94240a1940 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f943c000f60 tx=0x7f943c009040 comp rx=0 tx=0).stop 2024-04-17T02:22:39.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.678+0000 7f9449a38640 1 -- 172.21.15.17:0/1825136041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94440bb460 msgr2=0x7f94440b9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:39.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.678+0000 7f9449a38640 1 --2- 172.21.15.17:0/1825136041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94440bb460 0x7f94440b9c70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f942c02bee0 tx=0x7f942c0046c0 comp rx=0 tx=0).stop 2024-04-17T02:22:39.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.678+0000 7f9449a38640 1 -- 172.21.15.17:0/1825136041 shutdown_connections 2024-04-17T02:22:39.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.678+0000 7f9449a38640 1 --2- 172.21.15.17:0/1825136041 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f942409f480 0x7f94240a1940 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:39.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.678+0000 7f9449a38640 1 --2- 172.21.15.17:0/1825136041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94440bb460 0x7f94440b9c70 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:39.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.678+0000 7f9449a38640 1 --2- 172.21.15.17:0/1825136041 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9444142ac0 0x7f944414ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:39.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.678+0000 7f9449a38640 1 --2- 172.21.15.17:0/1825136041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94440ab5b0 0x7f9444145d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:39.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.678+0000 7f9449a38640 1 -- 172.21.15.17:0/1825136041 >> 172.21.15.17:0/1825136041 conn(0x7f94440ba940 msgr2=0x7f94440a76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:39.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.678+0000 7f9449a38640 1 -- 172.21.15.17:0/1825136041 shutdown_connections 2024-04-17T02:22:39.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.678+0000 7f9449a38640 1 -- 172.21.15.17:0/1825136041 wait complete. 2024-04-17T02:22:39.691 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T02:22:39.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.793+0000 7fd243b3d640 1 Processor -- start 2024-04-17T02:22:39.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.793+0000 7fd243b3d640 1 -- start start 2024-04-17T02:22:39.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.794+0000 7fd243b3d640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd23c0ab5b0 0x7fd23c0ac680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:39.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.794+0000 7fd243b3d640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd23c0acea0 con 0x7fd23c142c90 2024-04-17T02:22:39.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.794+0000 7fd243b3d640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd23c0acbc0 con 0x7fd23c0bb460 2024-04-17T02:22:39.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.794+0000 7fd243b3d640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fd23c0ab990 con 0x7fd23c0ab5b0 2024-04-17T02:22:39.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.794+0000 7fd2418d9640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd23c0ab5b0 0x7fd23c0ac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:39.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.794+0000 7fd2420da640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fd23c142c90 0x7fd23c14fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42128/0 (socket says 172.21.15.17:42128) 2024-04-17T02:22:39.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.794+0000 7fd2420da640 1 -- 172.21.15.17:0/1194379067 learned_addr learned my addr 172.21.15.17:0/1194379067 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:22:39.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.794+0000 7fd2408d7640 1 -- 172.21.15.17:0/1194379067 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4050528906 0 0) 0x7fd23c0acea0 con 0x7fd23c142c90 2024-04-17T02:22:39.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.795+0000 7fd2408d7640 1 -- 172.21.15.17:0/1194379067 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd228003520 con 0x7fd23c142c90 2024-04-17T02:22:39.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.795+0000 7fd2418d9640 1 -- 172.21.15.17:0/1194379067 >> v1:172.21.15.122:6789/0 conn(0x7fd23c0bb460 legacy=0x7fd23c142580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:39.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.795+0000 7fd2418d9640 1 -- 172.21.15.17:0/1194379067 >> v1:172.21.15.17:6789/0 conn(0x7fd23c142c90 legacy=0x7fd23c14fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:39.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.795+0000 7fd2418d9640 1 -- 172.21.15.17:0/1194379067 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd23c06dd30 con 0x7fd23c0ab5b0 2024-04-17T02:22:39.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.795+0000 7fd2418d9640 1 --2- 172.21.15.17:0/1194379067 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd23c0ab5b0 0x7fd23c0ac680 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd2380097d0 tx=0x7fd23802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8df7468e929ac1b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:39.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.795+0000 7fd2408d7640 1 -- 172.21.15.17:0/1194379067 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd238035020 con 0x7fd23c0ab5b0 2024-04-17T02:22:39.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.795+0000 7fd2408d7640 1 -- 172.21.15.17:0/1194379067 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd238031800 con 0x7fd23c0ab5b0 2024-04-17T02:22:39.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.795+0000 7fd2408d7640 1 -- 172.21.15.17:0/1194379067 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd238031bd0 con 0x7fd23c0ab5b0 2024-04-17T02:22:39.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.796+0000 7fd243b3d640 1 -- 172.21.15.17:0/1194379067 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd23c0ab5b0 msgr2=0x7fd23c0ac680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:39.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.796+0000 7fd243b3d640 1 --2- 172.21.15.17:0/1194379067 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd23c0ab5b0 0x7fd23c0ac680 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd2380097d0 tx=0x7fd23802b8a0 comp rx=0 tx=0).stop 2024-04-17T02:22:39.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.796+0000 7fd243b3d640 1 -- 172.21.15.17:0/1194379067 shutdown_connections 2024-04-17T02:22:39.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.796+0000 7fd243b3d640 1 --2- 172.21.15.17:0/1194379067 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd23c0ab5b0 0x7fd23c0ac680 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:39.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.796+0000 7fd243b3d640 1 -- 172.21.15.17:0/1194379067 >> 172.21.15.17:0/1194379067 conn(0x7fd23c0ba940 msgr2=0x7fd23c0bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:39.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.796+0000 7fd243b3d640 1 -- 172.21.15.17:0/1194379067 shutdown_connections 2024-04-17T02:22:39.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.796+0000 7fd243b3d640 1 -- 172.21.15.17:0/1194379067 wait complete. 2024-04-17T02:22:39.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.797+0000 7fd243b3d640 1 Processor -- start 2024-04-17T02:22:39.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.797+0000 7fd243b3d640 1 -- start start 2024-04-17T02:22:39.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.798+0000 7fd243b3d640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd23c0ab5b0 0x7fd23c148d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:39.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.798+0000 7fd243b3d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd23c0bb460 0x7fd23c13d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:39.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.798+0000 7fd243b3d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd23c142c90 0x7fd23c13bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:39.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.798+0000 7fd243b3d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd23c0a9700 con 0x7fd23c142c90 2024-04-17T02:22:39.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.798+0000 7fd243b3d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd23c0a9880 con 0x7fd23c0bb460 2024-04-17T02:22:39.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.798+0000 7fd243b3d640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fd23c1511b0 con 0x7fd23c0ab5b0 2024-04-17T02:22:39.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.798+0000 7fd2418d9640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd23c0ab5b0 0x7fd23c148d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:39.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.798+0000 7fd2418d9640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd23c0ab5b0 0x7fd23c148d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:53362/0 (socket says 172.21.15.17:53362) 2024-04-17T02:22:39.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.798+0000 7fd2418d9640 1 -- 172.21.15.17:0/1023753155 learned_addr learned my addr 172.21.15.17:0/1023753155 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:39.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.798+0000 7fd2420da640 1 --2- 172.21.15.17:0/1023753155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd23c142c90 0x7fd23c13bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:39.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.798+0000 7fd2410d8640 1 --2- 172.21.15.17:0/1023753155 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd23c0bb460 0x7fd23c13d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:39.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.798+0000 7fd2418d9640 1 -- 172.21.15.17:0/1023753155 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd23c0bb460 msgr2=0x7fd23c13d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:39.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.798+0000 7fd2418d9640 1 --2- 172.21.15.17:0/1023753155 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd23c0bb460 0x7fd23c13d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:39.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.798+0000 7fd2418d9640 1 -- 172.21.15.17:0/1023753155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd23c142c90 msgr2=0x7fd23c13bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:39.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.798+0000 7fd2418d9640 1 --2- 172.21.15.17:0/1023753155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd23c142c90 0x7fd23c13bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:39.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.798+0000 7fd2418d9640 1 -- 172.21.15.17:0/1023753155 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd23c13d7e0 con 0x7fd23c0ab5b0 2024-04-17T02:22:39.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.798+0000 7fd2410d8640 1 --2- 172.21.15.17:0/1023753155 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd23c0bb460 0x7fd23c13d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T02:22:39.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.798+0000 7fd2420da640 1 --2- 172.21.15.17:0/1023753155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd23c142c90 0x7fd23c13bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:39.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.798+0000 7fd2418d9640 1 --2- 172.21.15.17:0/1023753155 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd23c0ab5b0 0x7fd23c148d30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd23802beb0 tx=0x7fd2380046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:39.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.798+0000 7fd2327fc640 1 -- 172.21.15.17:0/1023753155 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd238048070 con 0x7fd23c0ab5b0 2024-04-17T02:22:39.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.798+0000 7fd2327fc640 1 -- 172.21.15.17:0/1023753155 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd23803bd70 con 0x7fd23c0ab5b0 2024-04-17T02:22:39.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.798+0000 7fd243b3d640 1 -- 172.21.15.17:0/1023753155 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd23c0bad20 con 0x7fd23c0ab5b0 2024-04-17T02:22:39.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.798+0000 7fd2327fc640 1 -- 172.21.15.17:0/1023753155 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd238043610 con 0x7fd23c0ab5b0 2024-04-17T02:22:39.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.799+0000 7fd243b3d640 1 -- 172.21.15.17:0/1023753155 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd23c13c100 con 0x7fd23c0ab5b0 2024-04-17T02:22:39.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.800+0000 7fd243b3d640 1 -- 172.21.15.17:0/1023753155 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd23c0008d0 con 0x7fd23c0ab5b0 2024-04-17T02:22:39.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.801+0000 7fd2327fc640 1 -- 172.21.15.17:0/1023753155 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7fd23804b070 con 0x7fd23c0ab5b0 2024-04-17T02:22:39.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.801+0000 7fd2327fc640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:39.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.801+0000 7fd2327fc640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:39.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.801+0000 7fd2327fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:39.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.801+0000 7fd2327fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:39.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.801+0000 7fd2327fc640 1 --2- 172.21.15.17:0/1023753155 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fd22009f4b0 0x7fd2200a1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:39.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.801+0000 7fd2410d8640 1 --2- 172.21.15.17:0/1023753155 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fd22009f4b0 0x7fd2200a1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:39.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.801+0000 7fd2327fc640 1 -- 172.21.15.17:0/1023753155 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7fd2380eb410 con 0x7fd23c0ab5b0 2024-04-17T02:22:39.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.802+0000 7fd2410d8640 1 --2- 172.21.15.17:0/1023753155 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fd22009f4b0 0x7fd2200a1970 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd23c1496f0 tx=0x7fd22c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:39.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:39.805+0000 7fd2327fc640 1 -- 172.21.15.17:0/1023753155 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fd238052020 con 0x7fd23c0ab5b0 2024-04-17T02:22:40.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.021+0000 7fd243b3d640 1 -- 172.21.15.17:0/1023753155 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd23c0687f0 con 0x7fd23c0ab5b0 2024-04-17T02:22:40.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.022+0000 7fd2327fc640 1 -- 172.21.15.17:0/1023753155 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4348 (secure 0 0 0) 0x7fd238040070 con 0x7fd23c0ab5b0 2024-04-17T02:22:40.023 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:22:40.023 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4228,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6813/1946927344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6811","nonce":1946927344},{"type":"v1","addr":"172.21.15.17:6813","nonce":1946927344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4234,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6825/529920036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":529920036},{"type":"v1","addr":"172.21.15.122:6825","nonce":529920036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T02:22:21.611698+0000","modified":"2024-04-17T02:22:23.609137+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6812/356803728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":356803728},{"type":"v1","addr":"172.21.15.17:6812","nonce":356803728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4254,"qdb_cluster":[4254]},"id":1}]} 2024-04-17T02:22:40.023 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 6 2024-04-17T02:22:40.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.024+0000 7fd243b3d640 10 mgrc shutdown 2024-04-17T02:22:40.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.024+0000 7fd243b3d640 1 -- 172.21.15.17:0/1023753155 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fd22009f4b0 msgr2=0x7fd2200a1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:40.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.024+0000 7fd243b3d640 1 --2- 172.21.15.17:0/1023753155 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fd22009f4b0 0x7fd2200a1970 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd23c1496f0 tx=0x7fd22c009040 comp rx=0 tx=0).stop 2024-04-17T02:22:40.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.024+0000 7fd243b3d640 1 -- 172.21.15.17:0/1023753155 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd23c0ab5b0 msgr2=0x7fd23c148d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:40.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.024+0000 7fd243b3d640 1 --2- 172.21.15.17:0/1023753155 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd23c0ab5b0 0x7fd23c148d30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd23802beb0 tx=0x7fd2380046c0 comp rx=0 tx=0).stop 2024-04-17T02:22:40.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.024+0000 7fd243b3d640 1 -- 172.21.15.17:0/1023753155 shutdown_connections 2024-04-17T02:22:40.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.024+0000 7fd243b3d640 1 --2- 172.21.15.17:0/1023753155 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fd22009f4b0 0x7fd2200a1970 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:40.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.024+0000 7fd243b3d640 1 --2- 172.21.15.17:0/1023753155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd23c142c90 0x7fd23c13bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:40.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.024+0000 7fd243b3d640 1 --2- 172.21.15.17:0/1023753155 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd23c0bb460 0x7fd23c13d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:40.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.024+0000 7fd243b3d640 1 --2- 172.21.15.17:0/1023753155 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fd23c0ab5b0 0x7fd23c148d30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:40.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.024+0000 7fd243b3d640 1 -- 172.21.15.17:0/1023753155 >> 172.21.15.17:0/1023753155 conn(0x7fd23c0ba940 msgr2=0x7fd23c13f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:40.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.024+0000 7fd243b3d640 1 -- 172.21.15.17:0/1023753155 shutdown_connections 2024-04-17T02:22:40.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.024+0000 7fd243b3d640 1 -- 172.21.15.17:0/1023753155 wait complete. 2024-04-17T02:22:40.338 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-17T02:22:21.611698+0000', 'modified': '2024-04-17T02:22:23.609137+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4254}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4254': {'gid': 4254, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.17:6812/356803728', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6810', 'nonce': 356803728}, {'type': 'v1', 'addr': '172.21.15.17:6812', 'nonce': 356803728}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4254, 'qdb_cluster': [4254]} 2024-04-17T02:22:40.338 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-17T02:22:40.339 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-17T02:22:40.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.447+0000 7f26d73f4640 1 Processor -- start 2024-04-17T02:22:40.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.447+0000 7f26d73f4640 1 -- start start 2024-04-17T02:22:40.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.448+0000 7f26d73f4640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f26d00a0520 0x7f26d006c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:40.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.448+0000 7f26d73f4640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f26d006d5c0 0x7f26d0143510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:40.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.448+0000 7f26d73f4640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26d00a1c60 con 0x7f26d00a1750 2024-04-17T02:22:40.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.448+0000 7f26d73f4640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f26d00a0900 con 0x7f26d006d5c0 2024-04-17T02:22:40.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.448+0000 7f26d73f4640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f26d00a1000 con 0x7f26d00a0520 2024-04-17T02:22:40.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.448+0000 7f26d498f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f26d006d5c0 0x7f26d0143510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:40.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.448+0000 7f26d5190640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f26d00a0520 0x7f26d006c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:40.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.448+0000 7f26d5991640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f26d00a1750 0x7f26d01463e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42144/0 (socket says 172.21.15.17:42144) 2024-04-17T02:22:40.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.448+0000 7f26d5991640 1 -- 172.21.15.17:0/3542234029 learned_addr learned my addr 172.21.15.17:0/3542234029 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:22:40.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.448+0000 7f26d498f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f26d006d5c0 0x7f26d0143510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52800/0 (socket says 172.21.15.17:52800) 2024-04-17T02:22:40.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.448+0000 7f26d498f640 1 -- 172.21.15.17:0/3542234029 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f26d00a0520 msgr2=0x7f26d006c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:40.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.448+0000 7f26d498f640 1 --2- 172.21.15.17:0/3542234029 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f26d00a0520 0x7f26d006c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:40.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.448+0000 7f26d498f640 1 -- 172.21.15.17:0/3542234029 >> v1:172.21.15.17:6789/0 conn(0x7f26d00a1750 legacy=0x7f26d01463e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:40.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.448+0000 7f26d498f640 1 -- 172.21.15.17:0/3542234029 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26d00a1f20 con 0x7f26d006d5c0 2024-04-17T02:22:40.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.448+0000 7f26c7fff640 1 -- 172.21.15.17:0/3542234029 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 6201020 0 0) 0x7f26d00a1c60 con 0x7f26d00a1750 2024-04-17T02:22:40.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.448+0000 7f26d5190640 1 --2- 172.21.15.17:0/3542234029 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f26d00a0520 0x7f26d006c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:40.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.449+0000 7f26d498f640 1 --2- 172.21.15.17:0/3542234029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26d006d5c0 0x7f26d0143510 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f26c00097a0 tx=0x7f26c002b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cae80e0d6652595 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:40.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.449+0000 7f26c7fff640 1 -- 172.21.15.17:0/3542234029 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c0031780 con 0x7f26d006d5c0 2024-04-17T02:22:40.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.449+0000 7f26c7fff640 1 -- 172.21.15.17:0/3542234029 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26c0037070 con 0x7f26d006d5c0 2024-04-17T02:22:40.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.449+0000 7f26c7fff640 1 -- 172.21.15.17:0/3542234029 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c0031b40 con 0x7f26d006d5c0 2024-04-17T02:22:40.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.449+0000 7f26d73f4640 1 -- 172.21.15.17:0/3542234029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26d006d5c0 msgr2=0x7f26d0143510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:40.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.449+0000 7f26d73f4640 1 --2- 172.21.15.17:0/3542234029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26d006d5c0 0x7f26d0143510 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f26c00097a0 tx=0x7f26c002b820 comp rx=0 tx=0).stop 2024-04-17T02:22:40.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.450+0000 7f26d73f4640 1 -- 172.21.15.17:0/3542234029 shutdown_connections 2024-04-17T02:22:40.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.450+0000 7f26d73f4640 1 --2- 172.21.15.17:0/3542234029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26d006d5c0 0x7f26d0143510 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:40.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.450+0000 7f26d73f4640 1 --2- 172.21.15.17:0/3542234029 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f26d00a0520 0x7f26d006c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:40.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.450+0000 7f26d73f4640 1 -- 172.21.15.17:0/3542234029 >> 172.21.15.17:0/3542234029 conn(0x7f26d00748d0 msgr2=0x7f26d00a59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:40.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.450+0000 7f26d73f4640 1 -- 172.21.15.17:0/3542234029 shutdown_connections 2024-04-17T02:22:40.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.450+0000 7f26d73f4640 1 -- 172.21.15.17:0/3542234029 wait complete. 2024-04-17T02:22:40.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.451+0000 7f26d73f4640 1 Processor -- start 2024-04-17T02:22:40.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.451+0000 7f26d73f4640 1 -- start start 2024-04-17T02:22:40.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.451+0000 7f26d73f4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26d006d5c0 0x7f26d009c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:40.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.451+0000 7f26d73f4640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f26d00a0520 0x7f26d009aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:40.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.451+0000 7f26d73f4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26d00a1750 0x7f26d009b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:40.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.451+0000 7f26d73f4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f26d00a52b0 con 0x7f26d00a1750 2024-04-17T02:22:40.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.451+0000 7f26d73f4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f26d006cc70 con 0x7f26d006d5c0 2024-04-17T02:22:40.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.451+0000 7f26d73f4640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f26d00a5430 con 0x7f26d00a0520 2024-04-17T02:22:40.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.451+0000 7f26d498f640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f26d00a0520 0x7f26d009aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:40.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.451+0000 7f26d5991640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26d00a1750 0x7f26d009b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:40.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.451+0000 7f26d498f640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f26d00a0520 0x7f26d009aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:53392/0 (socket says 172.21.15.17:53392) 2024-04-17T02:22:40.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.451+0000 7f26d498f640 1 -- 172.21.15.17:0/1568798389 learned_addr learned my addr 172.21.15.17:0/1568798389 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:40.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.452+0000 7f26d5190640 1 --2- 172.21.15.17:0/1568798389 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26d006d5c0 0x7f26d009c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:40.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.452+0000 7f26d498f640 1 -- 172.21.15.17:0/1568798389 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26d006d5c0 msgr2=0x7f26d009c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:40.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.452+0000 7f26d498f640 1 --2- 172.21.15.17:0/1568798389 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26d006d5c0 0x7f26d009c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:40.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.452+0000 7f26d498f640 1 -- 172.21.15.17:0/1568798389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26d00a1750 msgr2=0x7f26d009b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:40.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.452+0000 7f26d498f640 1 --2- 172.21.15.17:0/1568798389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26d00a1750 0x7f26d009b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:40.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.452+0000 7f26d498f640 1 -- 172.21.15.17:0/1568798389 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26d00714e0 con 0x7f26d00a0520 2024-04-17T02:22:40.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.452+0000 7f26d5991640 1 --2- 172.21.15.17:0/1568798389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26d00a1750 0x7f26d009b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:40.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.452+0000 7f26d5190640 1 --2- 172.21.15.17:0/1568798389 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26d006d5c0 0x7f26d009c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T02:22:40.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.452+0000 7f26d498f640 1 --2- 172.21.15.17:0/1568798389 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f26d00a0520 0x7f26d009aea0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f26c00097a0 tx=0x7f26c00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:40.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.452+0000 7f26c5ffb640 1 -- 172.21.15.17:0/1568798389 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c0004230 con 0x7f26d00a0520 2024-04-17T02:22:40.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.452+0000 7f26c5ffb640 1 -- 172.21.15.17:0/1568798389 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26c00043d0 con 0x7f26d00a0520 2024-04-17T02:22:40.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.452+0000 7f26c5ffb640 1 -- 172.21.15.17:0/1568798389 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c0003850 con 0x7f26d00a0520 2024-04-17T02:22:40.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.452+0000 7f26d73f4640 1 -- 172.21.15.17:0/1568798389 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26d01cede0 con 0x7f26d00a0520 2024-04-17T02:22:40.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.452+0000 7f26d73f4640 1 -- 172.21.15.17:0/1568798389 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f26d009cec0 con 0x7f26d00a0520 2024-04-17T02:22:40.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.454+0000 7f26c5ffb640 1 -- 172.21.15.17:0/1568798389 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f26c00039f0 con 0x7f26d00a0520 2024-04-17T02:22:40.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.454+0000 7f26c5ffb640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:22:40.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.455+0000 7f26c5ffb640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:22:40.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.455+0000 7f26c5ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:40.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.455+0000 7f26c5ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:22:40.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.455+0000 7f26c5ffb640 1 --2- 172.21.15.17:0/1568798389 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f26b409f480 0x7f26b40a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:40.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.455+0000 7f26d9fd3740 1 Processor -- start 2024-04-17T02:22:40.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.455+0000 7f26d9fd3740 1 -- start start 2024-04-17T02:22:40.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.455+0000 7f26d5190640 1 --2- 172.21.15.17:0/1568798389 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f26b409f480 0x7f26b40a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:40.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.455+0000 7f26c5ffb640 1 -- 172.21.15.17:0/1568798389 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f26c00eb1a0 con 0x7f26d00a0520 2024-04-17T02:22:40.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.455+0000 7f26d5190640 1 --2- 172.21.15.17:0/1568798389 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f26b409f480 0x7f26b40a1940 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f26cc009ac0 tx=0x7f26cc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:40.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.456+0000 7f26d9fd3740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555900f40700 0x555900f3fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:40.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.456+0000 7f26d9fd3740 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x555900f60060 0x555900f5dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:40.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.456+0000 7f26d9fd3740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555900f5e1a0 0x555900f60b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:40.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.456+0000 7f26d9fd3740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x555900ea5d80 con 0x555900f5e1a0 2024-04-17T02:22:40.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.456+0000 7f26d9fd3740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555900e4e5d0 con 0x555900f40700 2024-04-17T02:22:40.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.456+0000 7f26d9fd3740 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x555900ea1d40 con 0x555900f60060 2024-04-17T02:22:40.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.456+0000 7f26d5991640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555900f5e1a0 0x555900f60b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:40.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.456+0000 7f26d498f640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x555900f60060 0x555900f5dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:40.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.456+0000 7f26d5991640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555900f5e1a0 0x555900f60b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52822/0 (socket says 172.21.15.17:52822) 2024-04-17T02:22:40.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.456+0000 7f26d5991640 1 -- 172.21.15.17:0/1284462022 learned_addr learned my addr 172.21.15.17:0/1284462022 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:40.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.456+0000 7f26d5190640 1 --2- 172.21.15.17:0/1284462022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555900f40700 0x555900f3fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:40.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.456+0000 7f26d498f640 1 -- 172.21.15.17:0/1284462022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555900f40700 msgr2=0x555900f3fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:40.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.456+0000 7f26d498f640 1 --2- 172.21.15.17:0/1284462022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555900f40700 0x555900f3fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:40.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.456+0000 7f26d498f640 1 -- 172.21.15.17:0/1284462022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555900f5e1a0 msgr2=0x555900f60b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:40.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.456+0000 7f26d498f640 1 --2- 172.21.15.17:0/1284462022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555900f5e1a0 0x555900f60b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:40.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.456+0000 7f26d498f640 1 -- 172.21.15.17:0/1284462022 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555900bba2d0 con 0x555900f60060 2024-04-17T02:22:40.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.456+0000 7f26d5991640 1 --2- 172.21.15.17:0/1284462022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555900f5e1a0 0x555900f60b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:40.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.456+0000 7f26d498f640 1 --2- 172.21.15.17:0/1284462022 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x555900f60060 0x555900f5dc60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f26c00e9c00 tx=0x7f26c00b5f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50d439d976f45ee1 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:40.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.456+0000 7f26b2ffd640 1 -- 172.21.15.17:0/1284462022 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c00ba290 con 0x555900f60060 2024-04-17T02:22:40.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.456+0000 7f26b2ffd640 1 -- 172.21.15.17:0/1284462022 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26c0037070 con 0x555900f60060 2024-04-17T02:22:40.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.456+0000 7f26b2ffd640 1 -- 172.21.15.17:0/1284462022 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c00b9b90 con 0x555900f60060 2024-04-17T02:22:40.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.457+0000 7f26d9fd3740 1 -- 172.21.15.17:0/1284462022 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x555900f60060 msgr2=0x555900f5dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:40.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.457+0000 7f26d9fd3740 1 --2- 172.21.15.17:0/1284462022 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x555900f60060 0x555900f5dc60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f26c00e9c00 tx=0x7f26c00b5f60 comp rx=0 tx=0).stop 2024-04-17T02:22:40.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.457+0000 7f26d9fd3740 1 -- 172.21.15.17:0/1284462022 shutdown_connections 2024-04-17T02:22:40.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.457+0000 7f26d9fd3740 1 --2- 172.21.15.17:0/1284462022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555900f5e1a0 0x555900f60b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:40.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.457+0000 7f26d9fd3740 1 --2- 172.21.15.17:0/1284462022 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x555900f60060 0x555900f5dc60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:40.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.457+0000 7f26d9fd3740 1 --2- 172.21.15.17:0/1284462022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555900f40700 0x555900f3fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:40.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.457+0000 7f26d9fd3740 1 -- 172.21.15.17:0/1284462022 >> 172.21.15.17:0/1284462022 conn(0x555900f3df40 msgr2=0x555900f41500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:40.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.457+0000 7f26d9fd3740 1 -- 172.21.15.17:0/1284462022 shutdown_connections 2024-04-17T02:22:40.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.457+0000 7f26d9fd3740 1 -- 172.21.15.17:0/1284462022 wait complete. 2024-04-17T02:22:40.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.458+0000 7f26d9fd3740 1 -- start start 2024-04-17T02:22:40.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.458+0000 7f26d9fd3740 1 Processor -- start 2024-04-17T02:22:40.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.458+0000 7f26d9fd3740 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x555900f5e1a0 0x555900f68240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:40.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.458+0000 7f26d9fd3740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555900f60060 0x555900f669f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:40.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.458+0000 7f26d9fd3740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555900f5b840 0x555900f59f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:40.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.458+0000 7f26d9fd3740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x555900ea5d80 con 0x555900f5b840 2024-04-17T02:22:40.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.458+0000 7f26d9fd3740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555900e61b70 con 0x555900f60060 2024-04-17T02:22:40.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.458+0000 7f26d9fd3740 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x555900ea1d40 con 0x555900f5e1a0 2024-04-17T02:22:40.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.458+0000 7f26d9fd3740 10 client.0 _ll_register_callbacks cb 0x555900e61560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-17T02:22:40.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.458+0000 7f26d5190640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x555900f5e1a0 0x555900f68240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:40.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.459+0000 7f26d5991640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555900f5b840 0x555900f59f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:40.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.459+0000 7f26d5190640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x555900f5e1a0 0x555900f68240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:53400/0 (socket says 172.21.15.17:53400) 2024-04-17T02:22:40.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.459+0000 7f26d5190640 1 -- 172.21.15.17:0/65026586 learned_addr learned my addr 172.21.15.17:0/65026586 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:40.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.459+0000 7f26d498f640 1 --2- 172.21.15.17:0/65026586 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555900f60060 0x555900f669f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:40.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.459+0000 7f26d5991640 1 -- 172.21.15.17:0/65026586 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x555900f5e1a0 msgr2=0x555900f68240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:40.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.459+0000 7f26d5991640 1 --2- 172.21.15.17:0/65026586 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x555900f5e1a0 0x555900f68240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:40.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.459+0000 7f26d5991640 1 -- 172.21.15.17:0/65026586 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555900f60060 msgr2=0x555900f669f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:40.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.459+0000 7f26d5991640 1 --2- 172.21.15.17:0/65026586 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555900f60060 0x555900f669f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:40.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.459+0000 7f26d5991640 1 -- 172.21.15.17:0/65026586 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555900c846b0 con 0x555900f5b840 2024-04-17T02:22:40.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.459+0000 7f26d498f640 1 --2- 172.21.15.17:0/65026586 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555900f60060 0x555900f669f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T02:22:40.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.459+0000 7f26d5190640 1 --2- 172.21.15.17:0/65026586 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x555900f5e1a0 0x555900f68240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:40.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.459+0000 7f26d5991640 1 --2- 172.21.15.17:0/65026586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555900f5b840 0x555900f59f60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f26c8007430 tx=0x7f26c8007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19577d37985df430 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:40.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.459+0000 7f26abfff640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-04-17T02:22:40.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.459+0000 7f26abfff640 1 -- 172.21.15.17:0/65026586 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c8012a30 con 0x555900f5b840 2024-04-17T02:22:40.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.459+0000 7f26abfff640 1 -- 172.21.15.17:0/65026586 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f26c8012bd0 con 0x555900f5b840 2024-04-17T02:22:40.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.459+0000 7f26d9fd3740 1 -- 172.21.15.17:0/65026586 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26c0037070 con 0x555900f5b840 2024-04-17T02:22:40.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.459+0000 7f26abfff640 1 -- 172.21.15.17:0/65026586 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f26c8022050 con 0x555900f5b840 2024-04-17T02:22:40.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.459+0000 7f26d9fd3740 10 client.4650 fetch_fsmap learned FSMap version 6 2024-04-17T02:22:40.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.459+0000 7f26d9fd3740 1 -- 172.21.15.17:0/65026586 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x555900f59950 con 0x555900f5b840 2024-04-17T02:22:40.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.459+0000 7f26abfff640 1 -- 172.21.15.17:0/65026586 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26c0037070 con 0x555900f5b840 2024-04-17T02:22:40.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.460+0000 7f26abfff640 1 -- 172.21.15.17:0/65026586 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 6) ==== 2889+0+0 (secure 0 0 0) 0x7f26c8025020 con 0x555900f5b840 2024-04-17T02:22:40.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.460+0000 7f26d9fd3740 10 client.4650 fetch_fsmap finished waiting for FSMap version 6 2024-04-17T02:22:40.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.460+0000 7f26d9fd3740 10 client.4650 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-17T02:22:40.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.460+0000 7f26d9fd3740 20 client.4650 populate_metadata read hostname 'smithi017' 2024-04-17T02:22:40.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.460+0000 7f26d9fd3740 1 --2- 172.21.15.17:0/65026586 >> [v2:172.21.15.17:6810/356803728,v1:172.21.15.17:6812/356803728] conn(0x555900f8ad80 0x555900f8d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:40.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.460+0000 7f26d9fd3740 4 client.4650 mds_command: new command op to 4254 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-17T02:22:40.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.460+0000 7f26d9fd3740 1 -- 172.21.15.17:0/65026586 --> [v2:172.21.15.17:6810/356803728,v1:172.21.15.17:6812/356803728] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555900eb32c0 con 0x555900f8ad80 2024-04-17T02:22:40.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.460+0000 7f26d5190640 1 --2- 172.21.15.17:0/65026586 >> [v2:172.21.15.17:6810/356803728,v1:172.21.15.17:6812/356803728] conn(0x555900f8ad80 0x555900f8d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:40.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.460+0000 7f26d5190640 1 --2- 172.21.15.17:0/65026586 >> [v2:172.21.15.17:6810/356803728,v1:172.21.15.17:6812/356803728] conn(0x555900f8ad80 0x555900f8d170 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8780379e47884434 server_cookie=ebfcbbee8b3f2fe in_seq=0 out_seq=0 2024-04-17T02:22:40.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.460+0000 7f26abfff640 10 client.4650 ms_handle_connect on v2:172.21.15.17:6810/356803728 2024-04-17T02:22:40.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.461+0000 7f26abfff640 1 -- 172.21.15.17:0/65026586 <== mds.0 v2:172.21.15.17:6810/356803728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555900eb32c0 con 0x555900f8ad80 2024-04-17T02:22:40.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.461+0000 7f26abfff640 10 client.4650 handle_command_reply: tid=0 2024-04-17T02:22:40.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.461+0000 7f26d9fd3740 1 client.4650 shutdown 2024-04-17T02:22:40.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.461+0000 7f26d9fd3740 1 -- 172.21.15.17:0/65026586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555900f5b840 msgr2=0x555900f59f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:40.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.461+0000 7f26d9fd3740 1 --2- 172.21.15.17:0/65026586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555900f5b840 0x555900f59f60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f26c8007430 tx=0x7f26c8007830 comp rx=0 tx=0).stop 2024-04-17T02:22:40.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.461+0000 7f26d9fd3740 1 -- 172.21.15.17:0/65026586 shutdown_connections 2024-04-17T02:22:40.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.461+0000 7f26d9fd3740 1 --2- 172.21.15.17:0/65026586 >> [v2:172.21.15.17:6810/356803728,v1:172.21.15.17:6812/356803728] conn(0x555900f8ad80 0x555900f8d170 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:40.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.461+0000 7f26d9fd3740 1 --2- 172.21.15.17:0/65026586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555900f5b840 0x555900f59f60 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:40.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.461+0000 7f26d9fd3740 1 --2- 172.21.15.17:0/65026586 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555900f60060 0x555900f669f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:40.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.461+0000 7f26d9fd3740 1 --2- 172.21.15.17:0/65026586 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x555900f5e1a0 0x555900f68240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:40.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.461+0000 7f26abfff640 0 client.4650 ms_handle_reset on v2:172.21.15.17:6810/356803728 2024-04-17T02:22:40.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.461+0000 7f26d9fd3740 1 -- 172.21.15.17:0/65026586 >> 172.21.15.17:0/65026586 conn(0x555900f40700 msgr2=0x555900f3fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:40.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.461+0000 7f26d9fd3740 1 -- 172.21.15.17:0/65026586 shutdown_connections 2024-04-17T02:22:40.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.461+0000 7f26d9fd3740 1 -- 172.21.15.17:0/65026586 wait complete. 2024-04-17T02:22:40.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.461+0000 7f26d9fd3740 20 client.4650 trim_cache size 0 max 16384 2024-04-17T02:22:40.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.480+0000 7f26d9fd3740 1 Processor -- start 2024-04-17T02:22:40.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.480+0000 7f26d9fd3740 1 -- start start 2024-04-17T02:22:40.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.480+0000 7f26d9fd3740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555900f5b840 0x555900f5d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:40.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.480+0000 7f26d9fd3740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555900f5e1a0 0x555900f70980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:40.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.480+0000 7f26d9fd3740 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x555900f60060 0x555900f70ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:40.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.480+0000 7f26d9fd3740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f26d01e5200 con 0x555900f5b840 2024-04-17T02:22:40.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.480+0000 7f26d9fd3740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f26d01dc820 con 0x555900f5e1a0 2024-04-17T02:22:40.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.480+0000 7f26d9fd3740 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f26d01e4350 con 0x555900f60060 2024-04-17T02:22:40.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.481+0000 7f26d5190640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555900f5b840 0x555900f5d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:40.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.481+0000 7f26d5991640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x555900f60060 0x555900f70ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:40.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.481+0000 7f26d5190640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555900f5b840 0x555900f5d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52842/0 (socket says 172.21.15.17:52842) 2024-04-17T02:22:40.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.481+0000 7f26d5991640 1 --2- 172.21.15.17:0/3672557212 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x555900f60060 0x555900f70ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:53406/0 (socket says 172.21.15.17:53406) 2024-04-17T02:22:40.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.481+0000 7f26d5190640 1 -- 172.21.15.17:0/3672557212 learned_addr learned my addr 172.21.15.17:0/3672557212 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:40.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.481+0000 7f26d5190640 1 -- 172.21.15.17:0/3672557212 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x555900f60060 msgr2=0x555900f70ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:40.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.481+0000 7f26d5190640 1 --2- 172.21.15.17:0/3672557212 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x555900f60060 0x555900f70ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:40.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.481+0000 7f26d5190640 1 -- 172.21.15.17:0/3672557212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555900f5e1a0 msgr2=0x555900f70980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:40.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.481+0000 7f26d498f640 1 --2- 172.21.15.17:0/3672557212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555900f5e1a0 0x555900f70980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:40.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.481+0000 7f26d5190640 1 --2- 172.21.15.17:0/3672557212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555900f5e1a0 0x555900f70980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:40.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.481+0000 7f26d5190640 1 -- 172.21.15.17:0/3672557212 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555900f5a2d0 con 0x555900f5b840 2024-04-17T02:22:40.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.481+0000 7f26d5991640 1 --2- 172.21.15.17:0/3672557212 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x555900f60060 0x555900f70ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:40.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.481+0000 7f26d5190640 1 --2- 172.21.15.17:0/3672557212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555900f5b840 0x555900f5d740 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x555900f7ede0 tx=0x7f26cc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20ff4af32d26a863 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:40.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.481+0000 7f26b27fc640 1 -- 172.21.15.17:0/3672557212 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26cc01c070 con 0x555900f5b840 2024-04-17T02:22:40.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.481+0000 7f26b27fc640 1 -- 172.21.15.17:0/3672557212 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26cc01d040 con 0x555900f5b840 2024-04-17T02:22:40.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.481+0000 7f26b27fc640 1 -- 172.21.15.17:0/3672557212 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26cc00f040 con 0x555900f5b840 2024-04-17T02:22:40.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.482+0000 7f26d9fd3740 1 -- 172.21.15.17:0/3672557212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555900f5b840 msgr2=0x555900f5d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:40.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.482+0000 7f26d9fd3740 1 --2- 172.21.15.17:0/3672557212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555900f5b840 0x555900f5d740 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x555900f7ede0 tx=0x7f26cc013000 comp rx=0 tx=0).stop 2024-04-17T02:22:40.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.482+0000 7f26d9fd3740 1 -- 172.21.15.17:0/3672557212 shutdown_connections 2024-04-17T02:22:40.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.482+0000 7f26d9fd3740 1 --2- 172.21.15.17:0/3672557212 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x555900f60060 0x555900f70ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:40.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.482+0000 7f26d9fd3740 1 --2- 172.21.15.17:0/3672557212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555900f5e1a0 0x555900f70980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:40.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.482+0000 7f26d9fd3740 1 --2- 172.21.15.17:0/3672557212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555900f5b840 0x555900f5d740 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:40.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.482+0000 7f26d9fd3740 1 -- 172.21.15.17:0/3672557212 >> 172.21.15.17:0/3672557212 conn(0x555900f40700 msgr2=0x555900f372b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:40.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.482+0000 7f26d9fd3740 1 -- 172.21.15.17:0/3672557212 shutdown_connections 2024-04-17T02:22:40.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.482+0000 7f26d9fd3740 1 -- 172.21.15.17:0/3672557212 wait complete. 2024-04-17T02:22:40.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.482+0000 7f26d9fd3740 1 -- start start 2024-04-17T02:22:40.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.482+0000 7f26d9fd3740 1 Processor -- start 2024-04-17T02:22:40.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.483+0000 7f26d9fd3740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555900f5b840 0x555900f65eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:40.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.483+0000 7f26d9fd3740 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x555900f5e1a0 0x555900f7cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:40.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.483+0000 7f26d9fd3740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555900f60060 0x555900f91190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:40.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.483+0000 7f26d9fd3740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x555900f7e610 con 0x555900f5b840 2024-04-17T02:22:40.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.483+0000 7f26d9fd3740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555900f7e260 con 0x555900f60060 2024-04-17T02:22:40.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.483+0000 7f26d9fd3740 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x555900f7ec30 con 0x555900f5e1a0 2024-04-17T02:22:40.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.483+0000 7f26d9fd3740 10 client.0 _ll_register_callbacks cb 0x7f26c8007040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-17T02:22:40.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.483+0000 7f26d5190640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555900f5b840 0x555900f65eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:40.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.483+0000 7f26d498f640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x555900f5e1a0 0x555900f7cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:40.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.483+0000 7f26d5190640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555900f5b840 0x555900f65eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52848/0 (socket says 172.21.15.17:52848) 2024-04-17T02:22:40.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.483+0000 7f26d5190640 1 -- 172.21.15.17:0/303427433 learned_addr learned my addr 172.21.15.17:0/303427433 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:22:40.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.483+0000 7f26d5991640 1 --2- 172.21.15.17:0/303427433 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555900f60060 0x555900f91190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:40.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.484+0000 7f26d498f640 1 -- 172.21.15.17:0/303427433 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555900f60060 msgr2=0x555900f91190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:40.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.484+0000 7f26d498f640 1 --2- 172.21.15.17:0/303427433 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555900f60060 0x555900f91190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:40.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.484+0000 7f26d498f640 1 -- 172.21.15.17:0/303427433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555900f5b840 msgr2=0x555900f65eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:22:40.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.484+0000 7f26d498f640 1 --2- 172.21.15.17:0/303427433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555900f5b840 0x555900f65eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:40.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.484+0000 7f26d498f640 1 -- 172.21.15.17:0/303427433 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x555900f92880 con 0x555900f5e1a0 2024-04-17T02:22:40.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.484+0000 7f26d5190640 1 --2- 172.21.15.17:0/303427433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555900f5b840 0x555900f65eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:22:40.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.484+0000 7f26d498f640 1 --2- 172.21.15.17:0/303427433 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x555900f5e1a0 0x555900f7cc80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f26c00b9890 tx=0x7f26c00c0050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4de9df3c32d791dc server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:22:40.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.484+0000 7f26abfff640 10 client.0 ms_handle_connect on v2:172.21.15.17:3301/0 2024-04-17T02:22:40.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.484+0000 7f26abfff640 1 -- 172.21.15.17:0/303427433 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c00ba290 con 0x555900f5e1a0 2024-04-17T02:22:40.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.484+0000 7f26abfff640 1 -- 172.21.15.17:0/303427433 <== mon.2 v2:172.21.15.17:3301/0 2 ==== osd_map(20..20 src has 1..20) ==== 4334+0+0 (secure 0 0 0) 0x7f26c00b6200 con 0x555900f5e1a0 2024-04-17T02:22:40.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.484+0000 7f26d9fd3740 1 -- 172.21.15.17:0/303427433 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26cc01d040 con 0x555900f5e1a0 2024-04-17T02:22:40.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.484+0000 7f26abfff640 1 -- 172.21.15.17:0/303427433 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f26c00bdce0 con 0x555900f5e1a0 2024-04-17T02:22:40.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.484+0000 7f26d9fd3740 10 client.4505 fetch_fsmap learned FSMap version 6 2024-04-17T02:22:40.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.484+0000 7f26d9fd3740 1 -- 172.21.15.17:0/303427433 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x555900f40230 con 0x555900f5e1a0 2024-04-17T02:22:40.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.484+0000 7f26abfff640 1 -- 172.21.15.17:0/303427433 <== mon.2 v2:172.21.15.17:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26cc01d040 con 0x555900f5e1a0 2024-04-17T02:22:40.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.484+0000 7f26abfff640 1 -- 172.21.15.17:0/303427433 <== mon.2 v2:172.21.15.17:3301/0 5 ==== fsmap(e 6) ==== 2889+0+0 (secure 0 0 0) 0x7f26c0003ce0 con 0x555900f5e1a0 2024-04-17T02:22:40.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.484+0000 7f26d9fd3740 10 client.4505 fetch_fsmap finished waiting for FSMap version 6 2024-04-17T02:22:40.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.484+0000 7f26d9fd3740 10 client.4505 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-17T02:22:40.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.484+0000 7f26d9fd3740 20 client.4505 populate_metadata read hostname 'smithi017' 2024-04-17T02:22:40.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.484+0000 7f26d9fd3740 1 --2- 172.21.15.17:0/303427433 >> [v2:172.21.15.17:6810/356803728,v1:172.21.15.17:6812/356803728] conn(0x555900ff04e0 0x555900ff08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:22:40.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.484+0000 7f26d9fd3740 4 client.4505 mds_command: new command op to 4254 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-17T02:22:40.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.484+0000 7f26d9fd3740 1 -- 172.21.15.17:0/303427433 --> [v2:172.21.15.17:6810/356803728,v1:172.21.15.17:6812/356803728] -- command(tid 0: {"prefix": "status"}) -- 0x555900f649e0 con 0x555900ff04e0 2024-04-17T02:22:40.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.484+0000 7f26d5190640 1 --2- 172.21.15.17:0/303427433 >> [v2:172.21.15.17:6810/356803728,v1:172.21.15.17:6812/356803728] conn(0x555900ff04e0 0x555900ff08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:22:40.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.485+0000 7f26abfff640 10 client.4505 ms_handle_connect on v2:172.21.15.17:6810/356803728 2024-04-17T02:22:40.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.485+0000 7f26d5190640 1 --2- 172.21.15.17:0/303427433 >> [v2:172.21.15.17:6810/356803728,v1:172.21.15.17:6812/356803728] conn(0x555900ff04e0 0x555900ff08c0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=919983bf24cd331a server_cookie=9e81e23e4853cfb3 in_seq=0 out_seq=0 2024-04-17T02:22:40.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.485+0000 7f26abfff640 1 -- 172.21.15.17:0/303427433 <== mds.0 v2:172.21.15.17:6810/356803728 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x555900f649e0 con 0x555900ff04e0 2024-04-17T02:22:40.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.485+0000 7f26abfff640 10 client.4505 handle_command_reply: tid=0 2024-04-17T02:22:40.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.485+0000 7f26d9fd3740 1 client.4505 shutdown 2024-04-17T02:22:40.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.485+0000 7f26d9fd3740 1 -- 172.21.15.17:0/303427433 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x555900f5e1a0 msgr2=0x555900f7cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:40.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.485+0000 7f26d9fd3740 1 --2- 172.21.15.17:0/303427433 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x555900f5e1a0 0x555900f7cc80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f26c00b9890 tx=0x7f26c00c0050 comp rx=0 tx=0).stop 2024-04-17T02:22:40.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.485+0000 7f26d9fd3740 1 -- 172.21.15.17:0/303427433 shutdown_connections 2024-04-17T02:22:40.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.485+0000 7f26d9fd3740 1 --2- 172.21.15.17:0/303427433 >> [v2:172.21.15.17:6810/356803728,v1:172.21.15.17:6812/356803728] conn(0x555900ff04e0 0x555900ff08c0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:40.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.485+0000 7f26d9fd3740 1 --2- 172.21.15.17:0/303427433 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555900f60060 0x555900f91190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:40.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.485+0000 7f26abfff640 0 client.4505 ms_handle_reset on v2:172.21.15.17:6810/356803728 2024-04-17T02:22:40.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.485+0000 7f26d9fd3740 1 --2- 172.21.15.17:0/303427433 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x555900f5e1a0 0x555900f7cc80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:40.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.485+0000 7f26d9fd3740 1 --2- 172.21.15.17:0/303427433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555900f5b840 0x555900f65eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:40.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.485+0000 7f26d9fd3740 1 -- 172.21.15.17:0/303427433 >> 172.21.15.17:0/303427433 conn(0x555900f40700 msgr2=0x555900f5d740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:40.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.485+0000 7f26d9fd3740 1 -- 172.21.15.17:0/303427433 shutdown_connections 2024-04-17T02:22:40.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.485+0000 7f26d9fd3740 1 -- 172.21.15.17:0/303427433 wait complete. 2024-04-17T02:22:40.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.485+0000 7f26d9fd3740 20 client.4505 trim_cache size 0 max 16384 2024-04-17T02:22:40.496 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-04-17T02:22:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "7cbfae20-b10d-41da-92b7-cbd5c1632e23", 2024-04-17T02:22:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-04-17T02:22:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4254, 2024-04-17T02:22:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-04-17T02:22:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-04-17T02:22:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-04-17T02:22:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 18.244520934000001, 2024-04-17T02:22:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 6, 2024-04-17T02:22:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 20, 2024-04-17T02:22:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 20, 2024-04-17T02:22:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 23.259082850999999 2024-04-17T02:22:40.497 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-04-17T02:22:40.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.486+0000 7f26d73f4640 10 mgrc shutdown 2024-04-17T02:22:40.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.486+0000 7f26d73f4640 1 -- 172.21.15.17:0/1568798389 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f26b409f480 msgr2=0x7f26b40a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:40.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.486+0000 7f26d73f4640 1 --2- 172.21.15.17:0/1568798389 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f26b409f480 0x7f26b40a1940 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f26cc009ac0 tx=0x7f26cc008040 comp rx=0 tx=0).stop 2024-04-17T02:22:40.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.486+0000 7f26d73f4640 1 -- 172.21.15.17:0/1568798389 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f26d00a0520 msgr2=0x7f26d009aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:22:40.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.486+0000 7f26d73f4640 1 --2- 172.21.15.17:0/1568798389 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f26d00a0520 0x7f26d009aea0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f26c00097a0 tx=0x7f26c00046c0 comp rx=0 tx=0).stop 2024-04-17T02:22:40.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.486+0000 7f26d73f4640 1 -- 172.21.15.17:0/1568798389 shutdown_connections 2024-04-17T02:22:40.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.486+0000 7f26d73f4640 1 --2- 172.21.15.17:0/1568798389 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f26b409f480 0x7f26b40a1940 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:40.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.486+0000 7f26d73f4640 1 --2- 172.21.15.17:0/1568798389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26d00a1750 0x7f26d009b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:40.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.486+0000 7f26d73f4640 1 --2- 172.21.15.17:0/1568798389 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f26d00a0520 0x7f26d009aea0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:40.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.486+0000 7f26d73f4640 1 --2- 172.21.15.17:0/1568798389 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26d006d5c0 0x7f26d009c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:22:40.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.486+0000 7f26d73f4640 1 -- 172.21.15.17:0/1568798389 >> 172.21.15.17:0/1568798389 conn(0x7f26d00748d0 msgr2=0x7f26d0068ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:22:40.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.486+0000 7f26d73f4640 1 -- 172.21.15.17:0/1568798389 shutdown_connections 2024-04-17T02:22:40.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:22:40.486+0000 7f26d73f4640 1 -- 172.21.15.17:0/1568798389 wait complete. 2024-04-17T02:22:40.500 INFO:teuthology.run_tasks:Running task workunit... 2024-04-17T02:22:40.517 INFO:tasks.workunit:Pulling workunits from ref 687eba7a6534970dd256b49bc87e74b01871539e 2024-04-17T02:22:40.517 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-17T02:22:40.517 DEBUG:teuthology.orchestra.run.smithi017:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-17T02:22:40.532 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T02:22:40.533 INFO:teuthology.orchestra.run.smithi017.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-17T02:22:40.533 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-04-17T02:22:40.589 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-04-17T02:22:40.589 DEBUG:teuthology.orchestra.run.smithi017:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-04-17T02:22:40.643 INFO:tasks.workunit:timeout=3h 2024-04-17T02:22:40.644 INFO:tasks.workunit:cleanup=True 2024-04-17T02:22:40.644 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 687eba7a6534970dd256b49bc87e74b01871539e 2024-04-17T02:22:40.699 INFO:tasks.workunit.client.0.smithi017.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-17T02:23:04.589 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T02:23:04.592 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T02:23:31.910 INFO:tasks.workunit.client.0.smithi017.stderr:Note: switching to '687eba7a6534970dd256b49bc87e74b01871539e'. 2024-04-17T02:23:31.911 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-04-17T02:23:31.911 INFO:tasks.workunit.client.0.smithi017.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-17T02:23:31.911 INFO:tasks.workunit.client.0.smithi017.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-17T02:23:31.911 INFO:tasks.workunit.client.0.smithi017.stderr:state without impacting any branches by switching back to a branch. 2024-04-17T02:23:31.911 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-04-17T02:23:31.911 INFO:tasks.workunit.client.0.smithi017.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-17T02:23:31.911 INFO:tasks.workunit.client.0.smithi017.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-17T02:23:31.911 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-04-17T02:23:31.911 INFO:tasks.workunit.client.0.smithi017.stderr: git switch -c 2024-04-17T02:23:31.911 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-04-17T02:23:31.911 INFO:tasks.workunit.client.0.smithi017.stderr:Or undo this operation with: 2024-04-17T02:23:31.911 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-04-17T02:23:31.912 INFO:tasks.workunit.client.0.smithi017.stderr: git switch - 2024-04-17T02:23:31.912 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-04-17T02:23:31.912 INFO:tasks.workunit.client.0.smithi017.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-17T02:23:31.912 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-04-17T02:23:31.912 INFO:tasks.workunit.client.0.smithi017.stderr:HEAD is now at 687eba7a653 Merge PR #56432 into wip-yuriw-testing-20240416.150233 2024-04-17T02:23:31.916 DEBUG:teuthology.orchestra.run.smithi017:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-17T02:23:31.945 INFO:tasks.workunit.client.0.smithi017.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-17T02:23:31.947 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-17T02:23:31.947 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-17T02:23:32.602 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-17T02:23:32.672 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-17T02:23:32.713 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-17T02:23:32.714 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-17T02:23:32.714 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-17T02:23:32.754 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-17T02:23:32.757 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-04-17T02:23:32.757 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-17T02:23:32.813 INFO:tasks.workunit:Running workunits matching mgr/test_localpool.sh on client.0... 2024-04-17T02:23:32.816 INFO:tasks.workunit:Running workunit mgr/test_localpool.sh... 2024-04-17T02:23:32.816 DEBUG:teuthology.orchestra.run.smithi017:workunit test mgr/test_localpool.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=687eba7a6534970dd256b49bc87e74b01871539e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mgr/test_localpool.sh 2024-04-17T02:23:32.873 INFO:tasks.workunit.client.0.smithi017.stderr:+ ceph config set mgr mgr/localpool/subtree host 2024-04-17T02:23:32.955 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.953+0000 7fe70f615640 1 Processor -- start 2024-04-17T02:23:32.955 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.953+0000 7fe70f615640 1 -- start start 2024-04-17T02:23:32.958 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.954+0000 7fe70f615640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe708146f00 0x7fe708071170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:32.958 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.954+0000 7fe70f615640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe70806b730 con 0x7fe708141fd0 2024-04-17T02:23:32.958 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.954+0000 7fe70f615640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe70806eae0 con 0x7fe70806b350 2024-04-17T02:23:32.958 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.954+0000 7fe70f615640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fe7080716b0 con 0x7fe708146f00 2024-04-17T02:23:32.958 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.954+0000 7fe70cbb0640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe708146f00 0x7fe708071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:32.958 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.954+0000 7fe70dbb2640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fe708141fd0 0x7fe708142400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:51936/0 (socket says 172.21.15.17:51936) 2024-04-17T02:23:32.958 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.954+0000 7fe70dbb2640 1 -- 172.21.15.17:0/662580538 learned_addr learned my addr 172.21.15.17:0/662580538 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:23:32.958 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.954+0000 7fe70cbb0640 1 -- 172.21.15.17:0/662580538 >> v1:172.21.15.122:6789/0 conn(0x7fe70806b350 legacy=0x7fe7081467f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:32.958 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.954+0000 7fe70cbb0640 1 -- 172.21.15.17:0/662580538 >> v1:172.21.15.17:6789/0 conn(0x7fe708141fd0 legacy=0x7fe708142400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:32.958 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.954+0000 7fe70cbb0640 1 -- 172.21.15.17:0/662580538 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe708142b10 con 0x7fe708146f00 2024-04-17T02:23:32.959 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.955+0000 7fe70cbb0640 1 --2- 172.21.15.17:0/662580538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe708146f00 0x7fe708071170 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe6f80097a0 tx=0x7fe6f802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e6265f842db516 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:32.959 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.955+0000 7fe6fffff640 1 -- 172.21.15.17:0/662580538 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8035020 con 0x7fe708146f00 2024-04-17T02:23:32.959 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.955+0000 7fe6fffff640 1 -- 172.21.15.17:0/662580538 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6f8031830 con 0x7fe708146f00 2024-04-17T02:23:32.959 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.955+0000 7fe6fffff640 1 -- 172.21.15.17:0/662580538 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8031c00 con 0x7fe708146f00 2024-04-17T02:23:32.959 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.955+0000 7fe70f615640 1 -- 172.21.15.17:0/662580538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe708146f00 msgr2=0x7fe708071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:32.959 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.955+0000 7fe70f615640 1 --2- 172.21.15.17:0/662580538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe708146f00 0x7fe708071170 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe6f80097a0 tx=0x7fe6f802b8d0 comp rx=0 tx=0).stop 2024-04-17T02:23:32.959 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.956+0000 7fe70f615640 1 -- 172.21.15.17:0/662580538 shutdown_connections 2024-04-17T02:23:32.959 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.956+0000 7fe70f615640 1 --2- 172.21.15.17:0/662580538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe708146f00 0x7fe708071170 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:32.959 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.956+0000 7fe70f615640 1 -- 172.21.15.17:0/662580538 >> 172.21.15.17:0/662580538 conn(0x7fe7080a69f0 msgr2=0x7fe7080a6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:23:32.959 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.956+0000 7fe70f615640 1 -- 172.21.15.17:0/662580538 shutdown_connections 2024-04-17T02:23:32.959 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.956+0000 7fe70f615640 1 -- 172.21.15.17:0/662580538 wait complete. 2024-04-17T02:23:32.963 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.957+0000 7fe70f615640 1 Processor -- start 2024-04-17T02:23:32.963 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.957+0000 7fe70f615640 1 -- start start 2024-04-17T02:23:32.963 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.957+0000 7fe70f615640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe70806b350 0x7fe7080a2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:32.963 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.957+0000 7fe70f615640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fe708141fd0 0x7fe70809e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:32.963 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.957+0000 7fe70f615640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe708146f00 0x7fe708139390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:32.963 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.957+0000 7fe70f615640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe7081462e0 con 0x7fe708146f00 2024-04-17T02:23:32.964 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.957+0000 7fe70f615640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe708142e00 con 0x7fe70806b350 2024-04-17T02:23:32.964 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.957+0000 7fe70f615640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fe708143050 con 0x7fe708141fd0 2024-04-17T02:23:32.964 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.957+0000 7fe70dbb2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe708146f00 0x7fe708139390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:32.964 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.957+0000 7fe70cbb0640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fe708141fd0 0x7fe70809e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:32.964 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.957+0000 7fe70dbb2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe708146f00 0x7fe708139390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48378/0 (socket says 172.21.15.17:48378) 2024-04-17T02:23:32.964 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.957+0000 7fe70dbb2640 1 -- 172.21.15.17:0/204441648 learned_addr learned my addr 172.21.15.17:0/204441648 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:23:32.964 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.958+0000 7fe70d3b1640 1 --2- 172.21.15.17:0/204441648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe70806b350 0x7fe7080a2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:32.964 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.958+0000 7fe70dbb2640 1 -- 172.21.15.17:0/204441648 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fe708141fd0 msgr2=0x7fe70809e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:32.964 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.958+0000 7fe70dbb2640 1 --2- 172.21.15.17:0/204441648 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fe708141fd0 0x7fe70809e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:32.964 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.958+0000 7fe70dbb2640 1 -- 172.21.15.17:0/204441648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe70806b350 msgr2=0x7fe7080a2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:32.964 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.958+0000 7fe70dbb2640 1 --2- 172.21.15.17:0/204441648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe70806b350 0x7fe7080a2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:32.964 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.958+0000 7fe70dbb2640 1 -- 172.21.15.17:0/204441648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe70809f910 con 0x7fe708146f00 2024-04-17T02:23:32.964 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.958+0000 7fe70d3b1640 1 --2- 172.21.15.17:0/204441648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe70806b350 0x7fe7080a2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T02:23:32.965 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.958+0000 7fe70dbb2640 1 --2- 172.21.15.17:0/204441648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe708146f00 0x7fe708139390 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe70000c450 tx=0x7fe70000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:32.965 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.958+0000 7fe6fdffb640 1 -- 172.21.15.17:0/204441648 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe700017070 con 0x7fe708146f00 2024-04-17T02:23:32.965 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.958+0000 7fe6fdffb640 1 -- 172.21.15.17:0/204441648 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe700005ce0 con 0x7fe708146f00 2024-04-17T02:23:32.965 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.958+0000 7fe70f615640 1 -- 172.21.15.17:0/204441648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe70809fbd0 con 0x7fe708146f00 2024-04-17T02:23:32.965 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.958+0000 7fe6fdffb640 1 -- 172.21.15.17:0/204441648 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe700007270 con 0x7fe708146f00 2024-04-17T02:23:32.965 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.958+0000 7fe70f615640 1 -- 172.21.15.17:0/204441648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe70809ecd0 con 0x7fe708146f00 2024-04-17T02:23:32.965 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.959+0000 7fe70f615640 1 -- 172.21.15.17:0/204441648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe708068c70 con 0x7fe708146f00 2024-04-17T02:23:32.965 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.960+0000 7fe6fdffb640 1 -- 172.21.15.17:0/204441648 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7fe70001a070 con 0x7fe708146f00 2024-04-17T02:23:32.965 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.960+0000 7fe6fdffb640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:23:32.965 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.961+0000 7fe6fdffb640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:23:32.965 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.961+0000 7fe6fdffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:23:32.965 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.961+0000 7fe6fdffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:23:32.965 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.961+0000 7fe6fdffb640 1 --2- 172.21.15.17:0/204441648 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fe6ec09f480 0x7fe6ec0a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:32.965 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.961+0000 7fe6fdffb640 1 -- 172.21.15.17:0/204441648 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 4479+0+0 (secure 0 0 0) 0x7fe7000c8740 con 0x7fe708146f00 2024-04-17T02:23:32.966 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.961+0000 7fe70d3b1640 1 --2- 172.21.15.17:0/204441648 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fe6ec09f480 0x7fe6ec0a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:32.966 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.961+0000 7fe70d3b1640 1 --2- 172.21.15.17:0/204441648 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fe6ec09f480 0x7fe6ec0a1940 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe7040012e0 tx=0x7fe704009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:32.967 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:32.965+0000 7fe6fdffb640 1 -- 172.21.15.17:0/204441648 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe7000970c0 con 0x7fe708146f00 2024-04-17T02:23:33.152 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.150+0000 7fe70f615640 1 -- 172.21.15.17:0/204441648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mgr/localpool/subtree}] v 0) -- 0x7fe708143d20 con 0x7fe708146f00 2024-04-17T02:23:33.155 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.153+0000 7fe6fdffb640 1 -- 172.21.15.17:0/204441648 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/localpool/subtree}]=0 v6)=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7fe70009b160 con 0x7fe708146f00 2024-04-17T02:23:33.269 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.267+0000 7fe70f615640 1 -- 172.21.15.17:0/204441648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mgr/localpool/subtree}] v 0) -- 0x7fe70806ed40 con 0x7fe708146f00 2024-04-17T02:23:33.269 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.267+0000 7fe6fdffb640 1 -- 172.21.15.17:0/204441648 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mgr/localpool/subtree}]=0 v6)=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7fe70009fa20 con 0x7fe708146f00 2024-04-17T02:23:33.271 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.269+0000 7fe70f615640 10 mgrc shutdown 2024-04-17T02:23:33.272 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.269+0000 7fe70f615640 1 -- 172.21.15.17:0/204441648 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fe6ec09f480 msgr2=0x7fe6ec0a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:33.272 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.269+0000 7fe70f615640 1 --2- 172.21.15.17:0/204441648 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fe6ec09f480 0x7fe6ec0a1940 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe7040012e0 tx=0x7fe704009040 comp rx=0 tx=0).stop 2024-04-17T02:23:33.272 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.269+0000 7fe70f615640 1 -- 172.21.15.17:0/204441648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe708146f00 msgr2=0x7fe708139390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:33.272 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.269+0000 7fe70f615640 1 --2- 172.21.15.17:0/204441648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe708146f00 0x7fe708139390 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe70000c450 tx=0x7fe70000c910 comp rx=0 tx=0).stop 2024-04-17T02:23:33.272 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.269+0000 7fe70f615640 1 -- 172.21.15.17:0/204441648 shutdown_connections 2024-04-17T02:23:33.272 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.269+0000 7fe70f615640 1 --2- 172.21.15.17:0/204441648 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7fe6ec09f480 0x7fe6ec0a1940 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:33.272 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.269+0000 7fe70f615640 1 --2- 172.21.15.17:0/204441648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe708146f00 0x7fe708139390 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:33.272 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.269+0000 7fe70f615640 1 --2- 172.21.15.17:0/204441648 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fe708141fd0 0x7fe70809e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:33.272 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.269+0000 7fe70f615640 1 --2- 172.21.15.17:0/204441648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe70806b350 0x7fe7080a2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:33.272 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.269+0000 7fe70f615640 1 -- 172.21.15.17:0/204441648 >> 172.21.15.17:0/204441648 conn(0x7fe7080a69f0 msgr2=0x7fe708069180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:23:33.272 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.269+0000 7fe70f615640 1 -- 172.21.15.17:0/204441648 shutdown_connections 2024-04-17T02:23:33.272 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.269+0000 7fe70f615640 1 -- 172.21.15.17:0/204441648 wait complete. 2024-04-17T02:23:33.280 INFO:tasks.workunit.client.0.smithi017.stderr:+ ceph config set mgr mgr/localpool/failure_domain osd 2024-04-17T02:23:33.372 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.361+0000 7f91051e5640 1 Processor -- start 2024-04-17T02:23:33.373 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.361+0000 7f91051e5640 1 -- start start 2024-04-17T02:23:33.373 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.361+0000 7f91051e5640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f91000ab300 0x7f910006b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:33.373 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.361+0000 7f91051e5640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f91000ac450 0x7f91000a9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:33.373 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.361+0000 7f91051e5640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91000ac940 con 0x7f91001445b0 2024-04-17T02:23:33.373 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.361+0000 7f91051e5640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f91000acbe0 con 0x7f91000ab300 2024-04-17T02:23:33.374 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.361+0000 7f91051e5640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f910006c440 con 0x7f91000ac450 2024-04-17T02:23:33.374 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.361+0000 7f90fed9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f91000ab300 0x7f910006b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:33.374 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.361+0000 7f90fed9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f91000ab300 0x7f910006b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48386/0 (socket says 172.21.15.17:48386) 2024-04-17T02:23:33.374 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.361+0000 7f90fed9d640 1 -- 172.21.15.17:0/2475973355 learned_addr learned my addr 172.21.15.17:0/2475973355 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:23:33.374 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.362+0000 7f90fe59c640 1 --2- 172.21.15.17:0/2475973355 >> v2:172.21.15.122:3300/0 conn(0x7f91000ac450 0x7f91000a9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:33.374 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.362+0000 7f90fed9d640 1 -- 172.21.15.17:0/2475973355 >> v2:172.21.15.122:3300/0 conn(0x7f91000ac450 msgr2=0x7f91000a9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:23:33.375 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.362+0000 7f90fed9d640 1 --2- 172.21.15.17:0/2475973355 >> v2:172.21.15.122:3300/0 conn(0x7f91000ac450 0x7f91000a9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:33.375 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.362+0000 7f90fed9d640 1 -- 172.21.15.17:0/2475973355 >> v1:172.21.15.122:6789/0 conn(0x7f91001445b0 legacy=0x7f9100144a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:23:33.375 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.362+0000 7f90fed9d640 1 -- 172.21.15.17:0/2475973355 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f910006b9a0 con 0x7f91000ab300 2024-04-17T02:23:33.375 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.362+0000 7f90fed9d640 1 --2- 172.21.15.17:0/2475973355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91000ab300 0x7f910006b460 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f91000aa8e0 tx=0x7f90f002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ca0bda087a5c1a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:33.375 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.362+0000 7f90fdd9b640 1 -- 172.21.15.17:0/2475973355 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f0038070 con 0x7f91000ab300 2024-04-17T02:23:33.375 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.363+0000 7f90fdd9b640 1 -- 172.21.15.17:0/2475973355 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90f002f050 con 0x7f91000ab300 2024-04-17T02:23:33.376 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.363+0000 7f90fdd9b640 1 -- 172.21.15.17:0/2475973355 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f0031970 con 0x7f91000ab300 2024-04-17T02:23:33.376 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.363+0000 7f91051e5640 1 -- 172.21.15.17:0/2475973355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91000ab300 msgr2=0x7f910006b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:33.376 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.363+0000 7f91051e5640 1 --2- 172.21.15.17:0/2475973355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91000ab300 0x7f910006b460 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f91000aa8e0 tx=0x7f90f002b7f0 comp rx=0 tx=0).stop 2024-04-17T02:23:33.376 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.363+0000 7f91051e5640 1 -- 172.21.15.17:0/2475973355 shutdown_connections 2024-04-17T02:23:33.376 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.363+0000 7f91051e5640 1 --2- 172.21.15.17:0/2475973355 >> v2:172.21.15.122:3300/0 conn(0x7f91000ac450 0x7f91000a9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:33.376 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.363+0000 7f91051e5640 1 --2- 172.21.15.17:0/2475973355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91000ab300 0x7f910006b460 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:33.377 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.363+0000 7f91051e5640 1 -- 172.21.15.17:0/2475973355 >> 172.21.15.17:0/2475973355 conn(0x7f91000a9a70 msgr2=0x7f91000a9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:23:33.377 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.363+0000 7f91051e5640 1 -- 172.21.15.17:0/2475973355 shutdown_connections 2024-04-17T02:23:33.377 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.363+0000 7f91051e5640 1 -- 172.21.15.17:0/2475973355 wait complete. 2024-04-17T02:23:33.377 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.364+0000 7f91051e5640 1 Processor -- start 2024-04-17T02:23:33.377 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.364+0000 7f91051e5640 1 -- start start 2024-04-17T02:23:33.377 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.365+0000 7f91051e5640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f91000ab300 0x7f9100141400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:33.377 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.365+0000 7f91051e5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91000ac450 0x7f910013d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:33.377 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.365+0000 7f91051e5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91001445b0 0x7f91000b7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:33.377 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.365+0000 7f91051e5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f91000a96a0 con 0x7f91000ac450 2024-04-17T02:23:33.377 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.365+0000 7f91051e5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f91000ab6e0 con 0x7f91001445b0 2024-04-17T02:23:33.377 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.365+0000 7f91051e5640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f91000a9820 con 0x7f91000ab300 2024-04-17T02:23:33.377 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.365+0000 7f90fed9d640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f91000ab300 0x7f9100141400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:33.378 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.365+0000 7f90fe59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91000ac450 0x7f910013d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:33.378 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.365+0000 7f90fed9d640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f91000ab300 0x7f9100141400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:40606/0 (socket says 172.21.15.17:40606) 2024-04-17T02:23:33.378 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.365+0000 7f90fed9d640 1 -- 172.21.15.17:0/680779274 learned_addr learned my addr 172.21.15.17:0/680779274 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:23:33.378 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.365+0000 7f90ff59e640 1 --2- 172.21.15.17:0/680779274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91001445b0 0x7f91000b7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:33.378 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.365+0000 7f90fe59c640 1 -- 172.21.15.17:0/680779274 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f91000ab300 msgr2=0x7f9100141400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:33.378 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.365+0000 7f90fe59c640 1 --2- 172.21.15.17:0/680779274 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f91000ab300 0x7f9100141400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:33.378 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.365+0000 7f90fe59c640 1 -- 172.21.15.17:0/680779274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91001445b0 msgr2=0x7f91000b7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:33.378 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.365+0000 7f90fe59c640 1 --2- 172.21.15.17:0/680779274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91001445b0 0x7f91000b7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:33.378 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.365+0000 7f90fe59c640 1 -- 172.21.15.17:0/680779274 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9100147920 con 0x7f91000ac450 2024-04-17T02:23:33.379 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.365+0000 7f90fed9d640 1 --2- 172.21.15.17:0/680779274 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f91000ab300 0x7f9100141400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:23:33.379 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.365+0000 7f90ff59e640 1 --2- 172.21.15.17:0/680779274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91001445b0 0x7f91000b7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T02:23:33.379 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.365+0000 7f90fe59c640 1 --2- 172.21.15.17:0/680779274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91000ac450 0x7f910013d3b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f90f400c5e0 tx=0x7f90f400caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:33.379 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.366+0000 7f90e77fe640 1 -- 172.21.15.17:0/680779274 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f4015070 con 0x7f91000ac450 2024-04-17T02:23:33.379 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.366+0000 7f90e77fe640 1 -- 172.21.15.17:0/680779274 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90f4004220 con 0x7f91000ac450 2024-04-17T02:23:33.379 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.366+0000 7f91051e5640 1 -- 172.21.15.17:0/680779274 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9100146fc0 con 0x7f91000ac450 2024-04-17T02:23:33.379 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.366+0000 7f90e77fe640 1 -- 172.21.15.17:0/680779274 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f4003610 con 0x7f91000ac450 2024-04-17T02:23:33.379 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.366+0000 7f91051e5640 1 -- 172.21.15.17:0/680779274 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f910013d8f0 con 0x7f91000ac450 2024-04-17T02:23:33.379 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.367+0000 7f91051e5640 1 -- 172.21.15.17:0/680779274 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9100068c70 con 0x7f91000ac450 2024-04-17T02:23:33.379 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.368+0000 7f90e77fe640 1 -- 172.21.15.17:0/680779274 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f90f40037d0 con 0x7f91000ac450 2024-04-17T02:23:33.379 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.368+0000 7f90e77fe640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:23:33.379 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.369+0000 7f90e77fe640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:23:33.380 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.369+0000 7f90e77fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:23:33.380 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.369+0000 7f90e77fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:23:33.380 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.369+0000 7f90e77fe640 1 --2- 172.21.15.17:0/680779274 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f90ec09f480 0x7f90ec0a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:33.380 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.369+0000 7f90fed9d640 1 --2- 172.21.15.17:0/680779274 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f90ec09f480 0x7f90ec0a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:33.380 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.369+0000 7f90e77fe640 1 -- 172.21.15.17:0/680779274 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 4479+0+0 (secure 0 0 0) 0x7f90f40c9950 con 0x7f91000ac450 2024-04-17T02:23:33.380 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.369+0000 7f90fed9d640 1 --2- 172.21.15.17:0/680779274 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f90ec09f480 0x7f90ec0a1940 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f90f0009630 tx=0x7f90f0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:33.380 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.372+0000 7f90e77fe640 1 -- 172.21.15.17:0/680779274 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f90f4098880 con 0x7f91000ac450 2024-04-17T02:23:33.554 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.552+0000 7f91051e5640 1 -- 172.21.15.17:0/680779274 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mgr/localpool/failure_domain}] v 0) -- 0x7f9100073200 con 0x7f91000ac450 2024-04-17T02:23:33.557 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.555+0000 7f90e77fe640 1 -- 172.21.15.17:0/680779274 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/localpool/failure_domain}]=0 v7)=0 v7) ==== 128+0+0 (secure 0 0 0) 0x7f90f4098180 con 0x7f91000ac450 2024-04-17T02:23:33.668 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.666+0000 7f91051e5640 1 -- 172.21.15.17:0/680779274 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mgr/localpool/failure_domain}] v 0) -- 0x7f91000b7fa0 con 0x7f91000ac450 2024-04-17T02:23:33.668 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.666+0000 7f90e77fe640 1 -- 172.21.15.17:0/680779274 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mgr/localpool/failure_domain}]=0 v7)=0 v7) ==== 128+0+0 (secure 0 0 0) 0x7f90f409c2d0 con 0x7f91000ac450 2024-04-17T02:23:33.670 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.668+0000 7f91051e5640 10 mgrc shutdown 2024-04-17T02:23:33.670 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.668+0000 7f91051e5640 1 -- 172.21.15.17:0/680779274 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f90ec09f480 msgr2=0x7f90ec0a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:33.671 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.668+0000 7f91051e5640 1 --2- 172.21.15.17:0/680779274 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f90ec09f480 0x7f90ec0a1940 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f90f0009630 tx=0x7f90f0008030 comp rx=0 tx=0).stop 2024-04-17T02:23:33.671 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.668+0000 7f91051e5640 1 -- 172.21.15.17:0/680779274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91000ac450 msgr2=0x7f910013d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:33.671 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.668+0000 7f91051e5640 1 --2- 172.21.15.17:0/680779274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91000ac450 0x7f910013d3b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f90f400c5e0 tx=0x7f90f400caa0 comp rx=0 tx=0).stop 2024-04-17T02:23:33.671 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.668+0000 7f91051e5640 1 -- 172.21.15.17:0/680779274 shutdown_connections 2024-04-17T02:23:33.671 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.668+0000 7f91051e5640 1 --2- 172.21.15.17:0/680779274 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f90ec09f480 0x7f90ec0a1940 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:33.671 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.668+0000 7f91051e5640 1 --2- 172.21.15.17:0/680779274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91000ac450 0x7f910013d3b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:33.671 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.668+0000 7f91051e5640 1 --2- 172.21.15.17:0/680779274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91001445b0 0x7f91000b7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:33.671 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.668+0000 7f91051e5640 1 --2- 172.21.15.17:0/680779274 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f91000ab300 0x7f9100141400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:33.671 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.668+0000 7f91051e5640 1 -- 172.21.15.17:0/680779274 >> 172.21.15.17:0/680779274 conn(0x7f91000a9a70 msgr2=0x7f91000a7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:23:33.671 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.668+0000 7f91051e5640 1 -- 172.21.15.17:0/680779274 shutdown_connections 2024-04-17T02:23:33.671 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.668+0000 7f91051e5640 1 -- 172.21.15.17:0/680779274 wait complete. 2024-04-17T02:23:33.679 INFO:tasks.workunit.client.0.smithi017.stderr:+ ceph mgr module enable localpool 2024-04-17T02:23:33.761 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.759+0000 7f9cb3040640 1 Processor -- start 2024-04-17T02:23:33.761 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.759+0000 7f9cb3040640 1 -- start start 2024-04-17T02:23:33.764 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.760+0000 7f9cb3040640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9cac0a4ef0 0x7f9cac0a7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:33.764 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.760+0000 7f9cb3040640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cac06d010 con 0x7f9cac0a7bc0 2024-04-17T02:23:33.764 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.760+0000 7f9cb3040640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cac141610 con 0x7f9cac06f800 2024-04-17T02:23:33.764 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.760+0000 7f9cb3040640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f9cac1413f0 con 0x7f9cac0a4ef0 2024-04-17T02:23:33.764 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.760+0000 7f9cabfff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9cac0a4ef0 0x7f9cac0a7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:33.764 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.760+0000 7f9cb15dd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f9cac0a7bc0 0x7f9cac06c110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:51946/0 (socket says 172.21.15.17:51946) 2024-04-17T02:23:33.764 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.760+0000 7f9cb15dd640 1 -- 172.21.15.17:0/3200058969 learned_addr learned my addr 172.21.15.17:0/3200058969 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:23:33.764 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.760+0000 7f9cabfff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9cac0a4ef0 0x7f9cac0a7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:40610/0 (socket says 172.21.15.17:40610) 2024-04-17T02:23:33.764 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.760+0000 7f9cab7fe640 1 -- 172.21.15.17:0/3200058969 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 712842939 0 0) 0x7f9cac06d010 con 0x7f9cac0a7bc0 2024-04-17T02:23:33.765 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.760+0000 7f9cabfff640 1 -- 172.21.15.17:0/3200058969 >> v1:172.21.15.122:6789/0 conn(0x7f9cac06f800 legacy=0x7f9cac141d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:33.765 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.760+0000 7f9cabfff640 1 -- 172.21.15.17:0/3200058969 >> v1:172.21.15.17:6789/0 conn(0x7f9cac0a7bc0 legacy=0x7f9cac06c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:33.765 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.760+0000 7f9cabfff640 1 -- 172.21.15.17:0/3200058969 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cac06cd50 con 0x7f9cac0a4ef0 2024-04-17T02:23:33.765 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.761+0000 7f9cabfff640 1 --2- 172.21.15.17:0/3200058969 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9cac0a4ef0 0x7f9cac0a7680 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9c940097d0 tx=0x7f9c9402b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4344f889bd1f7fd8 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:33.765 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.761+0000 7f9cab7fe640 1 -- 172.21.15.17:0/3200058969 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c94034070 con 0x7f9cac0a4ef0 2024-04-17T02:23:33.765 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.761+0000 7f9cab7fe640 1 -- 172.21.15.17:0/3200058969 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c94030880 con 0x7f9cac0a4ef0 2024-04-17T02:23:33.765 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.761+0000 7f9cab7fe640 1 -- 172.21.15.17:0/3200058969 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c94030c50 con 0x7f9cac0a4ef0 2024-04-17T02:23:33.765 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.762+0000 7f9cb3040640 1 -- 172.21.15.17:0/3200058969 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9cac0a4ef0 msgr2=0x7f9cac0a7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:33.765 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.762+0000 7f9cb3040640 1 --2- 172.21.15.17:0/3200058969 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9cac0a4ef0 0x7f9cac0a7680 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9c940097d0 tx=0x7f9c9402b9c0 comp rx=0 tx=0).stop 2024-04-17T02:23:33.766 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.762+0000 7f9cb3040640 1 -- 172.21.15.17:0/3200058969 shutdown_connections 2024-04-17T02:23:33.766 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.762+0000 7f9cb3040640 1 --2- 172.21.15.17:0/3200058969 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9cac0a4ef0 0x7f9cac0a7680 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:33.766 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.762+0000 7f9cb3040640 1 -- 172.21.15.17:0/3200058969 >> 172.21.15.17:0/3200058969 conn(0x7f9cac0a5870 msgr2=0x7f9cac0a5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:23:33.766 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.762+0000 7f9cb3040640 1 -- 172.21.15.17:0/3200058969 shutdown_connections 2024-04-17T02:23:33.766 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.762+0000 7f9cb3040640 1 -- 172.21.15.17:0/3200058969 wait complete. 2024-04-17T02:23:33.771 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.763+0000 7f9cb3040640 1 Processor -- start 2024-04-17T02:23:33.771 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.763+0000 7f9cb3040640 1 -- start start 2024-04-17T02:23:33.771 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.763+0000 7f9cb3040640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9cac06f800 0x7f9cac09ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:33.771 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.763+0000 7f9cb3040640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9cac0a4ef0 0x7f9cac09efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:33.771 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.764+0000 7f9cb3040640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cac0a7bc0 0x7f9cac13d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:33.771 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.764+0000 7f9cb3040640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9cac0a6e80 con 0x7f9cac0a7bc0 2024-04-17T02:23:33.771 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.764+0000 7f9cb3040640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9cac06d620 con 0x7f9cac0a4ef0 2024-04-17T02:23:33.771 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.764+0000 7f9cb3040640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f9cac0a7000 con 0x7f9cac06f800 2024-04-17T02:23:33.771 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.764+0000 7f9cb0ddc640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9cac06f800 0x7f9cac09ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:33.771 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.764+0000 7f9cb0ddc640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9cac06f800 0x7f9cac09ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:40620/0 (socket says 172.21.15.17:40620) 2024-04-17T02:23:33.771 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.764+0000 7f9cb0ddc640 1 -- 172.21.15.17:0/1569846724 learned_addr learned my addr 172.21.15.17:0/1569846724 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:23:33.772 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.764+0000 7f9cb15dd640 1 --2- 172.21.15.17:0/1569846724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cac0a7bc0 0x7f9cac13d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:33.772 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.764+0000 7f9cabfff640 1 --2- 172.21.15.17:0/1569846724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9cac0a4ef0 0x7f9cac09efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:33.772 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.764+0000 7f9cb0ddc640 1 -- 172.21.15.17:0/1569846724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9cac0a4ef0 msgr2=0x7f9cac09efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:33.772 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.764+0000 7f9cb0ddc640 1 --2- 172.21.15.17:0/1569846724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9cac0a4ef0 0x7f9cac09efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:33.772 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.764+0000 7f9cb0ddc640 1 -- 172.21.15.17:0/1569846724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cac0a7bc0 msgr2=0x7f9cac13d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:33.772 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.764+0000 7f9cb0ddc640 1 --2- 172.21.15.17:0/1569846724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cac0a7bc0 0x7f9cac13d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:33.772 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.764+0000 7f9cb0ddc640 1 -- 172.21.15.17:0/1569846724 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cac13e500 con 0x7f9cac06f800 2024-04-17T02:23:33.772 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.764+0000 7f9cb0ddc640 1 --2- 172.21.15.17:0/1569846724 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9cac06f800 0x7f9cac09ea90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9ca400c430 tx=0x7f9ca400c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:33.772 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.764+0000 7f9ca97fa640 1 -- 172.21.15.17:0/1569846724 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4017070 con 0x7f9cac06f800 2024-04-17T02:23:33.772 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.764+0000 7f9ca97fa640 1 -- 172.21.15.17:0/1569846724 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ca40052d0 con 0x7f9cac06f800 2024-04-17T02:23:33.772 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.764+0000 7f9ca97fa640 1 -- 172.21.15.17:0/1569846724 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4003830 con 0x7f9cac06f800 2024-04-17T02:23:33.772 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.764+0000 7f9cb3040640 1 -- 172.21.15.17:0/1569846724 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cac13e7c0 con 0x7f9cac06f800 2024-04-17T02:23:33.772 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.764+0000 7f9cb3040640 1 -- 172.21.15.17:0/1569846724 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cac1d0c40 con 0x7f9cac06f800 2024-04-17T02:23:33.772 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.765+0000 7f9cb3040640 1 -- 172.21.15.17:0/1569846724 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cac068c70 con 0x7f9cac06f800 2024-04-17T02:23:33.772 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.766+0000 7f9ca97fa640 1 -- 172.21.15.17:0/1569846724 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 5) ==== 134917+0+0 (secure 0 0 0) 0x7f9ca401a070 con 0x7f9cac06f800 2024-04-17T02:23:33.773 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.766+0000 7f9ca97fa640 20 mgrc handle_mgr_map mgrmap(e 5) 2024-04-17T02:23:33.773 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.767+0000 7f9ca97fa640 4 mgrc handle_mgr_map Got map version 5 2024-04-17T02:23:33.773 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.767+0000 7f9ca97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:23:33.773 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.767+0000 7f9ca97fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:23:33.773 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.767+0000 7f9ca97fa640 1 --2- 172.21.15.17:0/1569846724 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f9c8c09f480 0x7f9c8c0a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:33.773 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.767+0000 7f9cabfff640 1 --2- 172.21.15.17:0/1569846724 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f9c8c09f480 0x7f9c8c0a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:33.773 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.767+0000 7f9ca97fa640 1 -- 172.21.15.17:0/1569846724 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 4479+0+0 (secure 0 0 0) 0x7f9ca40c8830 con 0x7f9cac06f800 2024-04-17T02:23:33.773 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.767+0000 7f9cabfff640 1 --2- 172.21.15.17:0/1569846724 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f9c8c09f480 0x7f9c8c0a1940 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9c94036000 tx=0x7f9c9403b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:33.773 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.771+0000 7f9ca97fa640 1 -- 172.21.15.17:0/1569846724 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f9ca4097110 con 0x7f9cac06f800 2024-04-17T02:23:34.001 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:33.999+0000 7f9cb3040640 1 -- 172.21.15.17:0/1569846724 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "mgr module enable", "module": "localpool"} v 0) -- 0x7f9cac073510 con 0x7f9cac06f800 2024-04-17T02:23:34.566 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:34.564+0000 7f9ca97fa640 1 -- 172.21.15.17:0/1569846724 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mgrmap(e 6) ==== 134930+0+0 (secure 0 0 0) 0x7f9ca4093780 con 0x7f9cac06f800 2024-04-17T02:23:34.566 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:34.564+0000 7f9ca97fa640 20 mgrc handle_mgr_map mgrmap(e 6) 2024-04-17T02:23:34.567 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:34.564+0000 7f9ca97fa640 4 mgrc handle_mgr_map Got map version 6 2024-04-17T02:23:34.567 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:34.564+0000 7f9ca97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:23:34.567 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:34.564+0000 7f9ca97fa640 1 -- 172.21.15.17:0/1569846724 <== mon.2 v2:172.21.15.17:3301/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "localpool"}]=0 v6) ==== 88+0+0 (secure 0 0 0) 0x7f9ca404bdf0 con 0x7f9cac06f800 2024-04-17T02:23:34.585 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:34.582+0000 7f9cabfff640 1 -- 172.21.15.17:0/1569846724 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f9c8c09f480 msgr2=0x7f9c8c0a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-04-17T02:23:34.585 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:34.582+0000 7f9cabfff640 1 -- 172.21.15.17:0/1569846724 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f9c8c09f480 msgr2=0x7f9c8c0a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-17T02:23:34.585 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:34.582+0000 7f9cabfff640 1 --2- 172.21.15.17:0/1569846724 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f9c8c09f480 0x7f9c8c0a1940 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9c94036000 tx=0x7f9c9403b040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T02:23:34.585 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:34.582+0000 7f9cabfff640 1 --2- 172.21.15.17:0/1569846724 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f9c8c09f480 0x7f9c8c0a1940 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9c94036000 tx=0x7f9c9403b040 comp rx=0 tx=0).stop 2024-04-17T02:23:34.586 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:34.582+0000 7f9ca97fa640 4 mgrc ms_handle_reset ms_handle_reset con 0x7f9c8c09f480 2024-04-17T02:23:34.586 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:34.582+0000 7f9ca97fa640 4 mgrc reconnect Terminating session with v2:172.21.15.17:6808/563692809 2024-04-17T02:23:34.586 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:34.582+0000 7f9ca97fa640 1 -- 172.21.15.17:0/1569846724 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f9c8c09f480 msgr2=0x7f9c8c0a1940 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-17T02:23:34.586 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:34.582+0000 7f9ca97fa640 1 --2- 172.21.15.17:0/1569846724 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f9c8c09f480 0x7f9c8c0a1940 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:34.586 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:34.582+0000 7f9ca97fa640 4 mgrc reconnect waiting to retry connect until 597.033513s 2024-04-17T02:23:34.653 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T02:23:34.655 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T02:23:34.744 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:34.742+0000 7f9cb3040640 1 -- 172.21.15.17:0/1569846724 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "mgr module enable", "module": "localpool"} v 0) -- 0x7f9c840050a0 con 0x7f9cac06f800 2024-04-17T02:23:34.769 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:34.767+0000 7f9ca37fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:23:34.769 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:34.767+0000 7f9ca37fe640 1 --2- 172.21.15.17:0/1569846724 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f9c8c09f480 0x7f9cac13dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:34.769 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:34.767+0000 7f9cabfff640 1 -- 172.21.15.17:0/1569846724 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f9c8c09f480 msgr2=0x7f9cac13dd80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6808/563692809 2024-04-17T02:23:34.770 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:34.767+0000 7f9cabfff640 1 --2- 172.21.15.17:0/1569846724 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f9c8c09f480 0x7f9cac13dd80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T02:23:34.970 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:34.968+0000 7f9cabfff640 1 -- 172.21.15.17:0/1569846724 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f9c8c09f480 msgr2=0x7f9cac13dd80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6808/563692809 2024-04-17T02:23:34.996 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:34.968+0000 7f9cabfff640 1 --2- 172.21.15.17:0/1569846724 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f9c8c09f480 0x7f9cac13dd80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T02:23:34.998 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:34.976+0000 7f1a90842040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-17T02:23:34.998 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:34.982+0000 7f1ce5493040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-17T02:23:34.999 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:34.976+0000 7fb8d8642040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-17T02:23:35.027 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:35.025+0000 7f1a90842040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-17T02:23:35.027 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:35.026+0000 7fb8d8642040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-17T02:23:35.032 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:35.030+0000 7f1ce5493040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-17T02:23:35.371 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.369+0000 7f9cabfff640 1 -- 172.21.15.17:0/1569846724 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f9c8c09f480 msgr2=0x7f9cac13dd80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6808/563692809 2024-04-17T02:23:35.371 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.369+0000 7f9cabfff640 1 --2- 172.21.15.17:0/1569846724 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f9c8c09f480 0x7f9cac13dd80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T02:23:35.429 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:35.428+0000 7f1a90842040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-17T02:23:35.429 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:35.428+0000 7fb8d8642040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-17T02:23:35.431 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:35.430+0000 7f1ce5493040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-17T02:23:35.475 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:35.474+0000 7f1a90842040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-17T02:23:35.475 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:35.474+0000 7fb8d8642040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-17T02:23:35.477 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:35.476+0000 7f1ce5493040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-17T02:23:35.520 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:35.519+0000 7fb8d8642040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-17T02:23:35.520 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:35.519+0000 7f1a90842040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-17T02:23:35.522 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:35.520+0000 7f1ce5493040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-17T02:23:35.566 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.564+0000 7f9ca97fa640 1 -- 172.21.15.17:0/1569846724 <== mon.2 v2:172.21.15.17:3301/0 9 ==== mgrmap(e 7) ==== 134930+0+0 (secure 0 0 0) 0x7f9ca40c7210 con 0x7f9cac06f800 2024-04-17T02:23:35.566 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.564+0000 7f9ca97fa640 20 mgrc handle_mgr_map mgrmap(e 7) 2024-04-17T02:23:35.567 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.564+0000 7f9ca97fa640 4 mgrc handle_mgr_map Got map version 7 2024-04-17T02:23:35.567 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.564+0000 7f9ca97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:23:35.567 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.564+0000 7f9ca97fa640 1 -- 172.21.15.17:0/1569846724 <== mon.2 v2:172.21.15.17:3301/0 10 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "localpool"}]=0 module 'localpool' is already enabled v7) ==== 125+0+0 (secure 0 0 0) 0x7f9ca40ce1d0 con 0x7f9cac06f800 2024-04-17T02:23:35.567 INFO:tasks.workunit.client.0.smithi017.stderr:module 'localpool' is already enabled 2024-04-17T02:23:35.570 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.566+0000 7f9cb3040640 10 mgrc shutdown 2024-04-17T02:23:35.570 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.566+0000 7f9cb3040640 1 -- 172.21.15.17:0/1569846724 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f9c8c09f480 msgr2=0x7f9cac13dd80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-17T02:23:35.570 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.566+0000 7f9cb3040640 1 --2- 172.21.15.17:0/1569846724 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f9c8c09f480 0x7f9cac13dd80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:35.570 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.566+0000 7f9cb3040640 1 -- 172.21.15.17:0/1569846724 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9cac06f800 msgr2=0x7f9cac09ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:35.570 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.566+0000 7f9cb3040640 1 --2- 172.21.15.17:0/1569846724 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9cac06f800 0x7f9cac09ea90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9ca400c430 tx=0x7f9ca400c8f0 comp rx=0 tx=0).stop 2024-04-17T02:23:35.571 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.567+0000 7f9cb3040640 1 -- 172.21.15.17:0/1569846724 shutdown_connections 2024-04-17T02:23:35.571 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.567+0000 7f9cb3040640 1 --2- 172.21.15.17:0/1569846724 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f9c8c09f480 0x7f9cac13dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:35.571 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.567+0000 7f9cb3040640 1 --2- 172.21.15.17:0/1569846724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cac0a7bc0 0x7f9cac13d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:35.571 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.567+0000 7f9cb3040640 1 --2- 172.21.15.17:0/1569846724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9cac0a4ef0 0x7f9cac09efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:35.571 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.567+0000 7f9cb3040640 1 --2- 172.21.15.17:0/1569846724 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f9cac06f800 0x7f9cac09ea90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:35.571 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.567+0000 7f9cb3040640 1 -- 172.21.15.17:0/1569846724 >> 172.21.15.17:0/1569846724 conn(0x7f9cac0a5870 msgr2=0x7f9cac0b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:23:35.572 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.567+0000 7f9cb3040640 1 -- 172.21.15.17:0/1569846724 shutdown_connections 2024-04-17T02:23:35.572 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.567+0000 7f9cb3040640 1 -- 172.21.15.17:0/1569846724 wait complete. 2024-04-17T02:23:35.576 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:35.575+0000 7fb8d8642040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-17T02:23:35.577 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:35.575+0000 7f1a90842040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-17T02:23:35.579 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:35.577+0000 7f1ce5493040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-17T02:23:35.580 INFO:tasks.workunit.client.0.smithi017.stderr:+ ceph osd pool ls 2024-04-17T02:23:35.580 INFO:tasks.workunit.client.0.smithi017.stderr:+ grep '^by-host-' 2024-04-17T02:23:35.620 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:35.619+0000 7f1a90842040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-17T02:23:35.620 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:35.619+0000 7fb8d8642040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-17T02:23:35.623 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:35.622+0000 7f1ce5493040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-17T02:23:35.661 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.659+0000 7f410f13e640 1 Processor -- start 2024-04-17T02:23:35.661 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.659+0000 7f410f13e640 1 -- start start 2024-04-17T02:23:35.664 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.660+0000 7f410f13e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f410806b450 0x7f41080a9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:35.664 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.660+0000 7f410f13e640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f41080ac7c0 0x7f4108144750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:35.665 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.660+0000 7f410f13e640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41080acd90 con 0x7f41080a8ce0 2024-04-17T02:23:35.665 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.660+0000 7f410f13e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f410806b830 con 0x7f410806b450 2024-04-17T02:23:35.665 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.660+0000 7f410f13e640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f41080ad050 con 0x7f41080ac7c0 2024-04-17T02:23:35.665 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.660+0000 7f410d6db640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f41080ac7c0 0x7f4108144750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:35.665 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.660+0000 7f410d6db640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f41080ac7c0 0x7f4108144750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:40648/0 (socket says 172.21.15.17:40648) 2024-04-17T02:23:35.665 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.660+0000 7f410ceda640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f410806b450 0x7f41080a9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:35.665 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.660+0000 7f410d6db640 1 -- 172.21.15.17:0/1366805545 learned_addr learned my addr 172.21.15.17:0/1366805545 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:23:35.665 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.660+0000 7f410d6db640 1 -- 172.21.15.17:0/1366805545 >> v2:172.21.15.17:3300/0 conn(0x7f410806b450 msgr2=0x7f41080a9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:23:35.665 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.660+0000 7f410d6db640 1 --2- 172.21.15.17:0/1366805545 >> v2:172.21.15.17:3300/0 conn(0x7f410806b450 0x7f41080a9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:35.665 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.660+0000 7f410d6db640 1 -- 172.21.15.17:0/1366805545 >> v1:172.21.15.122:6789/0 conn(0x7f41080a8ce0 legacy=0x7f41080ab5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:35.666 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.660+0000 7f410d6db640 1 -- 172.21.15.17:0/1366805545 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41080a97d0 con 0x7f41080ac7c0 2024-04-17T02:23:35.666 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.661+0000 7f410d6db640 1 --2- 172.21.15.17:0/1366805545 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f41080ac7c0 0x7f4108144750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4100009e50 tx=0x7f410002bfe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db6b58025b1429c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:35.666 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.661+0000 7f41077fe640 1 -- 172.21.15.17:0/1366805545 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f410002cb80 con 0x7f41080ac7c0 2024-04-17T02:23:35.666 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.661+0000 7f41077fe640 1 -- 172.21.15.17:0/1366805545 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f410002cd20 con 0x7f41080ac7c0 2024-04-17T02:23:35.666 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.661+0000 7f41077fe640 1 -- 172.21.15.17:0/1366805545 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4100034610 con 0x7f41080ac7c0 2024-04-17T02:23:35.666 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.662+0000 7f410f13e640 1 -- 172.21.15.17:0/1366805545 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f41080ac7c0 msgr2=0x7f4108144750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:35.666 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.662+0000 7f410f13e640 1 --2- 172.21.15.17:0/1366805545 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f41080ac7c0 0x7f4108144750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4100009e50 tx=0x7f410002bfe0 comp rx=0 tx=0).stop 2024-04-17T02:23:35.666 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.662+0000 7f410f13e640 1 -- 172.21.15.17:0/1366805545 shutdown_connections 2024-04-17T02:23:35.666 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.662+0000 7f410f13e640 1 --2- 172.21.15.17:0/1366805545 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f41080ac7c0 0x7f4108144750 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:35.666 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.662+0000 7f410f13e640 1 --2- 172.21.15.17:0/1366805545 >> v2:172.21.15.17:3300/0 conn(0x7f410806b450 0x7f41080a9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:35.667 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.662+0000 7f410f13e640 1 -- 172.21.15.17:0/1366805545 >> 172.21.15.17:0/1366805545 conn(0x7f41080a9a70 msgr2=0x7f41080a9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:23:35.667 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.662+0000 7f410f13e640 1 -- 172.21.15.17:0/1366805545 shutdown_connections 2024-04-17T02:23:35.667 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.662+0000 7f410f13e640 1 -- 172.21.15.17:0/1366805545 wait complete. 2024-04-17T02:23:35.667 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.663+0000 7f410f13e640 1 Processor -- start 2024-04-17T02:23:35.667 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.663+0000 7f410f13e640 1 -- start start 2024-04-17T02:23:35.670 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.663+0000 7f410f13e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f410806b450 0x7f4108148df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:35.670 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.663+0000 7f410f13e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41080a8ce0 0x7f410813fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:35.671 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.663+0000 7f410f13e640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f41080ac7c0 0x7f4108140320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:35.671 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.663+0000 7f410f13e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4108144ea0 con 0x7f41080a8ce0 2024-04-17T02:23:35.671 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.663+0000 7f410f13e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4108144d20 con 0x7f410806b450 2024-04-17T02:23:35.671 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.663+0000 7f410f13e640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f4108145020 con 0x7f41080ac7c0 2024-04-17T02:23:35.671 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.664+0000 7f410d6db640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f41080ac7c0 0x7f4108140320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:35.671 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.664+0000 7f4107fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41080a8ce0 0x7f410813fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:35.671 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.664+0000 7f4107fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41080a8ce0 0x7f410813fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48422/0 (socket says 172.21.15.17:48422) 2024-04-17T02:23:35.671 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.664+0000 7f410d6db640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f41080ac7c0 0x7f4108140320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:40664/0 (socket says 172.21.15.17:40664) 2024-04-17T02:23:35.671 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.664+0000 7f4107fff640 1 -- 172.21.15.17:0/874530703 learned_addr learned my addr 172.21.15.17:0/874530703 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:23:35.671 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.664+0000 7f410ceda640 1 --2- 172.21.15.17:0/874530703 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f410806b450 0x7f4108148df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:35.671 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.664+0000 7f410d6db640 1 -- 172.21.15.17:0/874530703 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f410806b450 msgr2=0x7f4108148df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:35.672 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.664+0000 7f410d6db640 1 --2- 172.21.15.17:0/874530703 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f410806b450 0x7f4108148df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:35.672 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.664+0000 7f410d6db640 1 -- 172.21.15.17:0/874530703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41080a8ce0 msgr2=0x7f410813fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:35.672 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.664+0000 7f410d6db640 1 --2- 172.21.15.17:0/874530703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41080a8ce0 0x7f410813fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:35.672 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.664+0000 7f410d6db640 1 -- 172.21.15.17:0/874530703 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4108143f00 con 0x7f41080ac7c0 2024-04-17T02:23:35.672 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.664+0000 7f410d6db640 1 --2- 172.21.15.17:0/874530703 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f41080ac7c0 0x7f4108140320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f41080acf80 tx=0x7f4100004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:35.672 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.664+0000 7f41057fa640 1 -- 172.21.15.17:0/874530703 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4100043020 con 0x7f41080ac7c0 2024-04-17T02:23:35.672 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.664+0000 7f41057fa640 1 -- 172.21.15.17:0/874530703 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f410003e450 con 0x7f41080ac7c0 2024-04-17T02:23:35.672 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.664+0000 7f41057fa640 1 -- 172.21.15.17:0/874530703 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4100009510 con 0x7f41080ac7c0 2024-04-17T02:23:35.672 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.664+0000 7f410f13e640 1 -- 172.21.15.17:0/874530703 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41081409d0 con 0x7f41080ac7c0 2024-04-17T02:23:35.672 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.664+0000 7f410f13e640 1 -- 172.21.15.17:0/874530703 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f41080a67e0 con 0x7f41080ac7c0 2024-04-17T02:23:35.672 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.665+0000 7f410f13e640 1 -- 172.21.15.17:0/874530703 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4108068c70 con 0x7f41080ac7c0 2024-04-17T02:23:35.672 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.666+0000 7f41057fa640 1 -- 172.21.15.17:0/874530703 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 7) ==== 134930+0+0 (secure 0 0 0) 0x7f4100046020 con 0x7f41080ac7c0 2024-04-17T02:23:35.672 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.666+0000 7f41057fa640 20 mgrc handle_mgr_map mgrmap(e 7) 2024-04-17T02:23:35.672 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.667+0000 7f41057fa640 4 mgrc handle_mgr_map Got map version 7 2024-04-17T02:23:35.673 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.667+0000 7f41057fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:23:35.673 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.667+0000 7f41057fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] 2024-04-17T02:23:35.673 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.667+0000 7f41057fa640 1 --2- 172.21.15.17:0/874530703 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f40ec09f4d0 0x7f40ec0a1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:35.673 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.667+0000 7f410ceda640 1 -- 172.21.15.17:0/874530703 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f40ec09f4d0 msgr2=0x7f40ec0a1990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6808/563692809 2024-04-17T02:23:35.673 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.667+0000 7f41057fa640 1 -- 172.21.15.17:0/874530703 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 4479+0+0 (secure 0 0 0) 0x7f41000ebbc0 con 0x7f41080ac7c0 2024-04-17T02:23:35.673 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.667+0000 7f410ceda640 1 --2- 172.21.15.17:0/874530703 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f40ec09f4d0 0x7f40ec0a1990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T02:23:35.673 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.672+0000 7f41057fa640 1 -- 172.21.15.17:0/874530703 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f410004d030 con 0x7f41080ac7c0 2024-04-17T02:23:35.738 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:35.737+0000 7f1a90842040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-17T02:23:35.739 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:35.737+0000 7fb8d8642040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-17T02:23:35.744 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:35.742+0000 7f1ce5493040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-17T02:23:35.794 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:35.793+0000 7f1a90842040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-17T02:23:35.794 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:35.793+0000 7fb8d8642040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-17T02:23:35.800 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:35.798+0000 7f1ce5493040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-17T02:23:35.838 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:35.837+0000 7f1a90842040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-17T02:23:35.839 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:35.837+0000 7fb8d8642040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-17T02:23:35.844 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:35.843+0000 7f1ce5493040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-17T02:23:35.857 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.856+0000 7f410f13e640 1 -- 172.21.15.17:0/874530703 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "osd pool ls"} v 0) -- 0x7f41080a4580 con 0x7f41080ac7c0 2024-04-17T02:23:35.857 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.856+0000 7f41057fa640 1 -- 172.21.15.17:0/874530703 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v22) ==== 59+0+37 (secure 0 0 0) 0x7f41000bab90 con 0x7f41080ac7c0 2024-04-17T02:23:35.869 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.869+0000 7f410ceda640 1 -- 172.21.15.17:0/874530703 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f40ec09f4d0 msgr2=0x7f40ec0a1990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6808/563692809 2024-04-17T02:23:35.870 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.869+0000 7f410ceda640 1 --2- 172.21.15.17:0/874530703 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f40ec09f4d0 0x7f40ec0a1990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T02:23:35.889 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:35.888+0000 7f1a90842040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-17T02:23:35.890 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:35.888+0000 7fb8d8642040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-17T02:23:35.895 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:35.894+0000 7f1ce5493040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-17T02:23:35.934 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:35.933+0000 7f1a90842040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-17T02:23:35.934 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:35.933+0000 7fb8d8642040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-17T02:23:35.939 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:35.939+0000 7f1ce5493040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-17T02:23:35.965 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.964+0000 7f410f13e640 1 -- 172.21.15.17:0/874530703 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "osd pool ls"} v 0) -- 0x7f41080b9b30 con 0x7f41080ac7c0 2024-04-17T02:23:35.965 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.964+0000 7f41057fa640 1 -- 172.21.15.17:0/874530703 <== mon.2 v2:172.21.15.17:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v22) ==== 59+0+37 (secure 0 0 0) 0x7f41000ba490 con 0x7f41080ac7c0 2024-04-17T02:23:35.968 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.966+0000 7f410f13e640 10 mgrc shutdown 2024-04-17T02:23:35.968 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.966+0000 7f410f13e640 1 -- 172.21.15.17:0/874530703 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f40ec09f4d0 msgr2=0x7f40ec0a1990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-17T02:23:35.968 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.966+0000 7f410f13e640 1 --2- 172.21.15.17:0/874530703 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f40ec09f4d0 0x7f40ec0a1990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:35.968 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.966+0000 7f410f13e640 1 -- 172.21.15.17:0/874530703 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f41080ac7c0 msgr2=0x7f4108140320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:35.968 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.966+0000 7f410f13e640 1 --2- 172.21.15.17:0/874530703 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f41080ac7c0 0x7f4108140320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f41080acf80 tx=0x7f4100004a40 comp rx=0 tx=0).stop 2024-04-17T02:23:35.968 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.966+0000 7f410f13e640 1 -- 172.21.15.17:0/874530703 shutdown_connections 2024-04-17T02:23:35.968 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.966+0000 7f410f13e640 1 --2- 172.21.15.17:0/874530703 >> [v2:172.21.15.17:6808/563692809,v1:172.21.15.17:6809/563692809] conn(0x7f40ec09f4d0 0x7f40ec0a1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:35.968 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.966+0000 7f410f13e640 1 --2- 172.21.15.17:0/874530703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41080a8ce0 0x7f410813fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:35.968 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.966+0000 7f410f13e640 1 --2- 172.21.15.17:0/874530703 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f41080ac7c0 0x7f4108140320 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:35.968 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.966+0000 7f410f13e640 1 --2- 172.21.15.17:0/874530703 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f410806b450 0x7f4108148df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:35.968 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.966+0000 7f410f13e640 1 -- 172.21.15.17:0/874530703 >> 172.21.15.17:0/874530703 conn(0x7f41080a9a70 msgr2=0x7f41080ba8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:23:35.969 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.967+0000 7f410f13e640 1 -- 172.21.15.17:0/874530703 shutdown_connections 2024-04-17T02:23:35.969 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:35.967+0000 7f410f13e640 1 -- 172.21.15.17:0/874530703 wait complete. 2024-04-17T02:23:35.977 INFO:tasks.workunit.client.0.smithi017.stderr:+ sleep 5 2024-04-17T02:23:36.269 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:36.267+0000 7f1a90842040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-17T02:23:36.269 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:36.267+0000 7fb8d8642040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-17T02:23:36.272 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:36.271+0000 7f1ce5493040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-17T02:23:36.405 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:36.404+0000 7f1a90842040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-17T02:23:36.406 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:36.404+0000 7fb8d8642040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-17T02:23:36.410 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:36.409+0000 7f1ce5493040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-17T02:23:36.502 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:36.501+0000 7f1a90842040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-17T02:23:36.502 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:36.501+0000 7fb8d8642040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-17T02:23:36.506 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:36.505+0000 7f1ce5493040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-17T02:23:36.547 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:36.545+0000 7fb8d8642040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-17T02:23:36.547 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:36.546+0000 7f1a90842040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-17T02:23:36.550 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:36.549+0000 7f1ce5493040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-17T02:23:36.662 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:36.661+0000 7f1a90842040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-17T02:23:36.662 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:36.661+0000 7fb8d8642040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-17T02:23:36.666 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:36.665+0000 7f1ce5493040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-17T02:23:36.758 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:36.757+0000 7f1a90842040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-17T02:23:36.758 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:36.757+0000 7fb8d8642040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-17T02:23:36.761 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:36.760+0000 7f1ce5493040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-17T02:23:36.917 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:36.915+0000 7f1a90842040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-17T02:23:36.917 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:36.916+0000 7fb8d8642040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-17T02:23:36.918 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:36.917+0000 7f1ce5493040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-17T02:23:36.960 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:36.959+0000 7f1a90842040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-17T02:23:36.961 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:36.959+0000 7fb8d8642040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-17T02:23:36.962 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:36.961+0000 7f1ce5493040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-17T02:23:37.085 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:37.084+0000 7f1a90842040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-17T02:23:37.085 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:37.084+0000 7fb8d8642040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-17T02:23:37.086 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:37.084+0000 7f1ce5493040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-17T02:23:37.725 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:37.724+0000 7f1ce5493040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-17T02:23:37.735 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:37.734+0000 7f1a90842040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-17T02:23:37.735 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:37.734+0000 7fb8d8642040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-17T02:23:38.000 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:37.999+0000 7f1ce5493040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-17T02:23:38.009 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:38.008+0000 7f1a90842040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-17T02:23:38.009 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:38.008+0000 7fb8d8642040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-17T02:23:38.051 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:38.050+0000 7f1ce5493040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-17T02:23:38.060 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:38.060+0000 7f1a90842040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-17T02:23:38.061 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:38.060+0000 7fb8d8642040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-17T02:23:38.170 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:38.169+0000 7f1ce5493040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-17T02:23:38.183 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:38.182+0000 7f1a90842040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-17T02:23:38.184 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:38.183+0000 7fb8d8642040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-17T02:23:38.230 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:38.229+0000 7f1c69827640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-17T02:23:38.230 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:38.229+0000 7f1c69827640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-17T02:23:38.230 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:38.229+0000 7f1c69827640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-17T02:23:38.230 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:38.229+0000 7f1c66fe2640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-17T02:23:38.230 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:38.229+0000 7f1c69827640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-17T02:23:38.230 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:38.229+0000 7f1c66fe2640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-17T02:23:38.230 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:38.229+0000 7f1c66fe2640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-17T02:23:38.231 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:38.229+0000 7f1c66fe2640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-17T02:23:38.231 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:38.229+0000 7f1c66fe2640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-17T02:23:38.231 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:38.229+0000 7f1c69827640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-17T02:23:40.979 INFO:tasks.workunit.client.0.smithi017.stderr:+ ceph osd pool ls 2024-04-17T02:23:40.979 INFO:tasks.workunit.client.0.smithi017.stderr:+ grep '^by-host-' 2024-04-17T02:23:41.070 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.068+0000 7fba2e69d640 1 Processor -- start 2024-04-17T02:23:41.070 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.068+0000 7fba2e69d640 1 -- start start 2024-04-17T02:23:41.071 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.069+0000 7fba2e69d640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fba2806b350 0x7fba28071170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:41.071 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.069+0000 7fba2e69d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fba281467f0 0x7fba28146bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:41.071 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.069+0000 7fba2e69d640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba2806b730 con 0x7fba28141fd0 2024-04-17T02:23:41.071 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.069+0000 7fba2e69d640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fba280716b0 con 0x7fba281467f0 2024-04-17T02:23:41.071 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.069+0000 7fba2e69d640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fba28142e00 con 0x7fba2806b350 2024-04-17T02:23:41.071 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.069+0000 7fba277fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fba281467f0 0x7fba28146bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:41.071 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.069+0000 7fba27fff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fba2806b350 0x7fba28071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:41.071 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.069+0000 7fba2cc3a640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fba28141fd0 0x7fba28142440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:57758/0 (socket says 172.21.15.17:57758) 2024-04-17T02:23:41.071 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.069+0000 7fba277fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fba281467f0 0x7fba28146bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58426/0 (socket says 172.21.15.17:58426) 2024-04-17T02:23:41.071 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.069+0000 7fba2cc3a640 1 -- 172.21.15.17:0/764999973 learned_addr learned my addr 172.21.15.17:0/764999973 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:23:41.071 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.069+0000 7fba277fe640 1 -- 172.21.15.17:0/764999973 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fba2806b350 msgr2=0x7fba28071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:23:41.071 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.069+0000 7fba277fe640 1 --2- 172.21.15.17:0/764999973 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fba2806b350 0x7fba28071170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:41.071 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.069+0000 7fba277fe640 1 -- 172.21.15.17:0/764999973 >> v1:172.21.15.17:6789/0 conn(0x7fba28141fd0 legacy=0x7fba28142440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:41.071 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.069+0000 7fba277fe640 1 -- 172.21.15.17:0/764999973 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba28142b50 con 0x7fba281467f0 2024-04-17T02:23:41.071 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.069+0000 7fba26ffd640 1 -- 172.21.15.17:0/764999973 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 679515563 0 0) 0x7fba2806b730 con 0x7fba28141fd0 2024-04-17T02:23:41.072 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.069+0000 7fba27fff640 1 --2- 172.21.15.17:0/764999973 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fba2806b350 0x7fba28071170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:23:41.073 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.070+0000 7fba277fe640 1 --2- 172.21.15.17:0/764999973 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba281467f0 0x7fba28146bf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fba1c0097a0 tx=0x7fba1c02b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88345c5a2a685f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:41.073 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.070+0000 7fba26ffd640 1 -- 172.21.15.17:0/764999973 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1c031780 con 0x7fba281467f0 2024-04-17T02:23:41.073 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.070+0000 7fba26ffd640 1 -- 172.21.15.17:0/764999973 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba1c037070 con 0x7fba281467f0 2024-04-17T02:23:41.073 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.070+0000 7fba26ffd640 1 -- 172.21.15.17:0/764999973 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1c031b40 con 0x7fba281467f0 2024-04-17T02:23:41.073 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.071+0000 7fba2e69d640 1 -- 172.21.15.17:0/764999973 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba281467f0 msgr2=0x7fba28146bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:41.073 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.071+0000 7fba2e69d640 1 --2- 172.21.15.17:0/764999973 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba281467f0 0x7fba28146bf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fba1c0097a0 tx=0x7fba1c02b820 comp rx=0 tx=0).stop 2024-04-17T02:23:41.074 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.071+0000 7fba2e69d640 1 -- 172.21.15.17:0/764999973 shutdown_connections 2024-04-17T02:23:41.074 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.071+0000 7fba2e69d640 1 --2- 172.21.15.17:0/764999973 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba281467f0 0x7fba28146bf0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:41.074 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.071+0000 7fba2e69d640 1 --2- 172.21.15.17:0/764999973 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fba2806b350 0x7fba28071170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:41.074 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.071+0000 7fba2e69d640 1 -- 172.21.15.17:0/764999973 >> 172.21.15.17:0/764999973 conn(0x7fba280a69f0 msgr2=0x7fba280a6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:23:41.074 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.071+0000 7fba2e69d640 1 -- 172.21.15.17:0/764999973 shutdown_connections 2024-04-17T02:23:41.074 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.071+0000 7fba2e69d640 1 -- 172.21.15.17:0/764999973 wait complete. 2024-04-17T02:23:41.074 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.072+0000 7fba2e69d640 1 Processor -- start 2024-04-17T02:23:41.074 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.072+0000 7fba2e69d640 1 -- start start 2024-04-17T02:23:41.077 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.073+0000 7fba2e69d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba2806b350 0x7fba280a8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:41.077 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.073+0000 7fba2e69d640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fba28141fd0 0x7fba280b4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:41.077 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.073+0000 7fba2e69d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba281467f0 0x7fba281dd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:41.077 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.073+0000 7fba2e69d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fba281462e0 con 0x7fba2806b350 2024-04-17T02:23:41.077 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.073+0000 7fba2e69d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fba2806eb70 con 0x7fba281467f0 2024-04-17T02:23:41.078 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.073+0000 7fba2e69d640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fba28147130 con 0x7fba28141fd0 2024-04-17T02:23:41.078 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.073+0000 7fba27fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba2806b350 0x7fba280a8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:41.078 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.073+0000 7fba277fe640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fba28141fd0 0x7fba280b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:41.078 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.073+0000 7fba27fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba2806b350 0x7fba280a8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58432/0 (socket says 172.21.15.17:58432) 2024-04-17T02:23:41.078 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.073+0000 7fba277fe640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fba28141fd0 0x7fba280b4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:37914/0 (socket says 172.21.15.17:37914) 2024-04-17T02:23:41.078 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.073+0000 7fba27fff640 1 -- 172.21.15.17:0/643880265 learned_addr learned my addr 172.21.15.17:0/643880265 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:23:41.078 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.073+0000 7fba2cc3a640 1 --2- 172.21.15.17:0/643880265 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba281467f0 0x7fba281dd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:41.078 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.073+0000 7fba27fff640 1 -- 172.21.15.17:0/643880265 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fba28141fd0 msgr2=0x7fba280b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:41.078 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.073+0000 7fba27fff640 1 --2- 172.21.15.17:0/643880265 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fba28141fd0 0x7fba280b4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:41.078 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.073+0000 7fba27fff640 1 -- 172.21.15.17:0/643880265 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba281467f0 msgr2=0x7fba281dd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:41.079 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.073+0000 7fba27fff640 1 --2- 172.21.15.17:0/643880265 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba281467f0 0x7fba281dd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:41.079 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.073+0000 7fba27fff640 1 -- 172.21.15.17:0/643880265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba280a9de0 con 0x7fba2806b350 2024-04-17T02:23:41.079 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.073+0000 7fba27fff640 1 --2- 172.21.15.17:0/643880265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba2806b350 0x7fba280a8980 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fba1800ec10 tx=0x7fba1800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:41.079 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.074+0000 7fba24ff9640 1 -- 172.21.15.17:0/643880265 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba18017070 con 0x7fba2806b350 2024-04-17T02:23:41.079 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.074+0000 7fba24ff9640 1 -- 172.21.15.17:0/643880265 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba1800cc30 con 0x7fba2806b350 2024-04-17T02:23:41.079 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.074+0000 7fba2e69d640 1 -- 172.21.15.17:0/643880265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba28099e40 con 0x7fba2806b350 2024-04-17T02:23:41.079 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.074+0000 7fba24ff9640 1 -- 172.21.15.17:0/643880265 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba18013470 con 0x7fba2806b350 2024-04-17T02:23:41.079 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.074+0000 7fba2e69d640 1 -- 172.21.15.17:0/643880265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba280a9340 con 0x7fba2806b350 2024-04-17T02:23:41.079 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.075+0000 7fba2e69d640 1 -- 172.21.15.17:0/643880265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba28068c70 con 0x7fba2806b350 2024-04-17T02:23:41.079 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.076+0000 7fba24ff9640 1 -- 172.21.15.17:0/643880265 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 10) ==== 134976+0+0 (secure 0 0 0) 0x7fba1801a070 con 0x7fba2806b350 2024-04-17T02:23:41.079 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.076+0000 7fba24ff9640 20 mgrc handle_mgr_map mgrmap(e 10) 2024-04-17T02:23:41.079 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.076+0000 7fba24ff9640 4 mgrc handle_mgr_map Got map version 10 2024-04-17T02:23:41.079 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.076+0000 7fba24ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] 2024-04-17T02:23:41.079 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.076+0000 7fba24ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] 2024-04-17T02:23:41.079 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.076+0000 7fba24ff9640 1 --2- 172.21.15.17:0/643880265 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7fba1409f560 0x7fba140a1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:41.080 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.076+0000 7fba24ff9640 1 -- 172.21.15.17:0/643880265 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5166+0+0 (secure 0 0 0) 0x7fba180c9780 con 0x7fba2806b350 2024-04-17T02:23:41.080 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.076+0000 7fba277fe640 1 --2- 172.21.15.17:0/643880265 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7fba1409f560 0x7fba140a1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:41.080 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.077+0000 7fba277fe640 1 --2- 172.21.15.17:0/643880265 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7fba1409f560 0x7fba140a1a20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fba1c036000 tx=0x7fba1c03d040 comp rx=0 tx=0).ready entity=mgr.4689 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:41.082 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.081+0000 7fba24ff9640 1 -- 172.21.15.17:0/643880265 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fba180984b0 con 0x7fba2806b350 2024-04-17T02:23:41.283 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.281+0000 7fba2e69d640 1 -- 172.21.15.17:0/643880265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool ls"} v 0) -- 0x7fba2806ed40 con 0x7fba2806b350 2024-04-17T02:23:41.283 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.282+0000 7fba24ff9640 1 -- 172.21.15.17:0/643880265 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v26) ==== 59+0+55 (secure 0 0 0) 0x7fba18097db0 con 0x7fba2806b350 2024-04-17T02:23:41.394 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.393+0000 7fba2e69d640 1 -- 172.21.15.17:0/643880265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool ls"} v 0) -- 0x7fba280a9b20 con 0x7fba2806b350 2024-04-17T02:23:41.394 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.393+0000 7fba24ff9640 1 -- 172.21.15.17:0/643880265 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v26) ==== 59+0+55 (secure 0 0 0) 0x7fba1809bf00 con 0x7fba2806b350 2024-04-17T02:23:41.396 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.395+0000 7fba2e69d640 10 mgrc shutdown 2024-04-17T02:23:41.396 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.395+0000 7fba2e69d640 1 -- 172.21.15.17:0/643880265 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7fba1409f560 msgr2=0x7fba140a1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:41.396 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.395+0000 7fba2e69d640 1 --2- 172.21.15.17:0/643880265 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7fba1409f560 0x7fba140a1a20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fba1c036000 tx=0x7fba1c03d040 comp rx=0 tx=0).stop 2024-04-17T02:23:41.396 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.395+0000 7fba2e69d640 1 -- 172.21.15.17:0/643880265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba2806b350 msgr2=0x7fba280a8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:41.397 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.395+0000 7fba2e69d640 1 --2- 172.21.15.17:0/643880265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba2806b350 0x7fba280a8980 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fba1800ec10 tx=0x7fba1800c520 comp rx=0 tx=0).stop 2024-04-17T02:23:41.397 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.395+0000 7fba2e69d640 1 -- 172.21.15.17:0/643880265 shutdown_connections 2024-04-17T02:23:41.397 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.395+0000 7fba2e69d640 1 --2- 172.21.15.17:0/643880265 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7fba1409f560 0x7fba140a1a20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:41.397 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.395+0000 7fba2e69d640 1 --2- 172.21.15.17:0/643880265 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba281467f0 0x7fba281dd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:41.397 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.395+0000 7fba2e69d640 1 --2- 172.21.15.17:0/643880265 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fba28141fd0 0x7fba280b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:41.397 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.395+0000 7fba2e69d640 1 --2- 172.21.15.17:0/643880265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba2806b350 0x7fba280a8980 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:41.397 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.395+0000 7fba2e69d640 1 -- 172.21.15.17:0/643880265 >> 172.21.15.17:0/643880265 conn(0x7fba280a69f0 msgr2=0x7fba28141840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:23:41.397 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.395+0000 7fba2e69d640 1 -- 172.21.15.17:0/643880265 shutdown_connections 2024-04-17T02:23:41.397 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.395+0000 7fba2e69d640 1 -- 172.21.15.17:0/643880265 wait complete. 2024-04-17T02:23:41.405 INFO:tasks.workunit.client.0.smithi017.stdout:by-host-smithi017 2024-04-17T02:23:41.405 INFO:tasks.workunit.client.0.smithi017.stderr:+ ceph mgr module disable localpool 2024-04-17T02:23:41.487 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.485+0000 7f5f6e4d4640 1 Processor -- start 2024-04-17T02:23:41.488 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.485+0000 7f5f6e4d4640 1 -- start start 2024-04-17T02:23:41.488 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.486+0000 7f5f6e4d4640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5f680a5f50 0x7f5f680730e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:41.488 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.486+0000 7f5f6e4d4640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f5f680a58e0 0x7f5f68144520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:41.488 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.486+0000 7f5f6e4d4640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f5f680a81f0 0x7f5f68144a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:41.488 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.486+0000 7f5f6e4d4640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f5f680a7400 con 0x7f5f680a58e0 2024-04-17T02:23:41.488 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.486+0000 7f5f6e4d4640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f5f680a76c0 con 0x7f5f680a5f50 2024-04-17T02:23:41.488 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.486+0000 7f5f6e4d4640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f5f68144fa0 con 0x7f5f680a81f0 2024-04-17T02:23:41.488 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.486+0000 7f5f6ca71640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f5f680a81f0 0x7f5f68144a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:41.488 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.486+0000 7f5f677fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f5f680a58e0 0x7f5f68144520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:41.488 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.486+0000 7f5f6ca71640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f5f680a81f0 0x7f5f68144a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:37916/0 (socket says 172.21.15.17:37916) 2024-04-17T02:23:41.488 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.486+0000 7f5f6ca71640 1 -- 172.21.15.17:0/514319005 learned_addr learned my addr 172.21.15.17:0/514319005 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:23:41.488 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.486+0000 7f5f67fff640 1 --2- 172.21.15.17:0/514319005 >> v2:172.21.15.122:3300/0 conn(0x7f5f680a5f50 0x7f5f680730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:41.488 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.486+0000 7f5f6ca71640 1 -- 172.21.15.17:0/514319005 >> v2:172.21.15.122:3300/0 conn(0x7f5f680a5f50 msgr2=0x7f5f680730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:23:41.489 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.486+0000 7f5f6ca71640 1 --2- 172.21.15.17:0/514319005 >> v2:172.21.15.122:3300/0 conn(0x7f5f680a5f50 0x7f5f680730e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:41.489 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.486+0000 7f5f6ca71640 1 -- 172.21.15.17:0/514319005 >> v2:172.21.15.17:3300/0 conn(0x7f5f680a58e0 msgr2=0x7f5f68144520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:23:41.489 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.486+0000 7f5f6ca71640 1 --2- 172.21.15.17:0/514319005 >> v2:172.21.15.17:3300/0 conn(0x7f5f680a58e0 0x7f5f68144520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:41.489 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.486+0000 7f5f6ca71640 1 -- 172.21.15.17:0/514319005 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f6806c1f0 con 0x7f5f680a81f0 2024-04-17T02:23:41.489 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.486+0000 7f5f677fe640 1 --2- 172.21.15.17:0/514319005 >> v2:172.21.15.17:3300/0 conn(0x7f5f680a58e0 0x7f5f68144520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:23:41.489 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.486+0000 7f5f67fff640 1 --2- 172.21.15.17:0/514319005 >> v2:172.21.15.122:3300/0 conn(0x7f5f680a5f50 0x7f5f680730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T02:23:41.492 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.487+0000 7f5f6ca71640 1 --2- 172.21.15.17:0/514319005 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f5f680a81f0 0x7f5f68144a60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5f6806f580 tx=0x7f5f6002be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cda5027ee21ff96 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:41.492 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.487+0000 7f5f66ffd640 1 -- 172.21.15.17:0/514319005 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6002c9e0 con 0x7f5f680a81f0 2024-04-17T02:23:41.492 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.487+0000 7f5f66ffd640 1 -- 172.21.15.17:0/514319005 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f6002cb80 con 0x7f5f680a81f0 2024-04-17T02:23:41.492 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.487+0000 7f5f66ffd640 1 -- 172.21.15.17:0/514319005 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f600343f0 con 0x7f5f680a81f0 2024-04-17T02:23:41.492 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.488+0000 7f5f6e4d4640 1 -- 172.21.15.17:0/514319005 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f5f680a81f0 msgr2=0x7f5f68144a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:41.492 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.488+0000 7f5f6e4d4640 1 --2- 172.21.15.17:0/514319005 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f5f680a81f0 0x7f5f68144a60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5f6806f580 tx=0x7f5f6002be40 comp rx=0 tx=0).stop 2024-04-17T02:23:41.492 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.488+0000 7f5f6e4d4640 1 -- 172.21.15.17:0/514319005 shutdown_connections 2024-04-17T02:23:41.492 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.488+0000 7f5f6e4d4640 1 --2- 172.21.15.17:0/514319005 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f5f680a81f0 0x7f5f68144a60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:41.493 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.488+0000 7f5f6e4d4640 1 --2- 172.21.15.17:0/514319005 >> v2:172.21.15.17:3300/0 conn(0x7f5f680a58e0 0x7f5f68144520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:41.493 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.488+0000 7f5f6e4d4640 1 --2- 172.21.15.17:0/514319005 >> v2:172.21.15.122:3300/0 conn(0x7f5f680a5f50 0x7f5f680730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:41.493 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.488+0000 7f5f6e4d4640 1 -- 172.21.15.17:0/514319005 >> 172.21.15.17:0/514319005 conn(0x7f5f68074820 msgr2=0x7f5f680a7ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:23:41.493 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.488+0000 7f5f6e4d4640 1 -- 172.21.15.17:0/514319005 shutdown_connections 2024-04-17T02:23:41.493 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.488+0000 7f5f6e4d4640 1 -- 172.21.15.17:0/514319005 wait complete. 2024-04-17T02:23:41.493 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.489+0000 7f5f6e4d4640 1 Processor -- start 2024-04-17T02:23:41.493 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.489+0000 7f5f6e4d4640 1 -- start start 2024-04-17T02:23:41.493 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.489+0000 7f5f6e4d4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f680a58e0 0x7f5f6813bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:41.493 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.489+0000 7f5f6e4d4640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f5f680a5f50 0x7f5f680b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:41.493 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.489+0000 7f5f6e4d4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5f680a81f0 0x7f5f680b8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:41.493 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.489+0000 7f5f6e4d4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5f680a6330 con 0x7f5f680a58e0 2024-04-17T02:23:41.493 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.489+0000 7f5f6e4d4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5f680a70a0 con 0x7f5f680a81f0 2024-04-17T02:23:41.493 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.489+0000 7f5f6e4d4640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f5f68073620 con 0x7f5f680a5f50 2024-04-17T02:23:41.493 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.490+0000 7f5f67fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f680a58e0 0x7f5f6813bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:41.494 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.490+0000 7f5f677fe640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f5f680a5f50 0x7f5f680b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:41.494 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.490+0000 7f5f677fe640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f5f680a5f50 0x7f5f680b72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:37932/0 (socket says 172.21.15.17:37932) 2024-04-17T02:23:41.494 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.490+0000 7f5f677fe640 1 -- 172.21.15.17:0/4236648644 learned_addr learned my addr 172.21.15.17:0/4236648644 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:23:41.494 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.490+0000 7f5f67fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f680a58e0 0x7f5f6813bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58454/0 (socket says 172.21.15.17:58454) 2024-04-17T02:23:41.494 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.490+0000 7f5f6ca71640 1 --2- 172.21.15.17:0/4236648644 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5f680a81f0 0x7f5f680b8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:41.494 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.490+0000 7f5f677fe640 1 -- 172.21.15.17:0/4236648644 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5f680a81f0 msgr2=0x7f5f680b8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:41.494 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.490+0000 7f5f677fe640 1 --2- 172.21.15.17:0/4236648644 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5f680a81f0 0x7f5f680b8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:41.494 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.490+0000 7f5f677fe640 1 -- 172.21.15.17:0/4236648644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f680a58e0 msgr2=0x7f5f6813bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:41.494 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.490+0000 7f5f677fe640 1 --2- 172.21.15.17:0/4236648644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f680a58e0 0x7f5f6813bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:41.494 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.490+0000 7f5f677fe640 1 -- 172.21.15.17:0/4236648644 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f681dd7b0 con 0x7f5f680a5f50 2024-04-17T02:23:41.494 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.490+0000 7f5f677fe640 1 --2- 172.21.15.17:0/4236648644 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f5f680a5f50 0x7f5f680b72c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c00ec10 tx=0x7f5f5c00c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:41.494 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.490+0000 7f5f64ff9640 1 -- 172.21.15.17:0/4236648644 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c017070 con 0x7f5f680a5f50 2024-04-17T02:23:41.494 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.490+0000 7f5f64ff9640 1 -- 172.21.15.17:0/4236648644 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f5c00cc30 con 0x7f5f680a5f50 2024-04-17T02:23:41.494 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.490+0000 7f5f64ff9640 1 -- 172.21.15.17:0/4236648644 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c013470 con 0x7f5f680a5f50 2024-04-17T02:23:41.495 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.490+0000 7f5f6e4d4640 1 -- 172.21.15.17:0/4236648644 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f680b7b90 con 0x7f5f680a5f50 2024-04-17T02:23:41.495 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.490+0000 7f5f6e4d4640 1 -- 172.21.15.17:0/4236648644 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f681493f0 con 0x7f5f680a5f50 2024-04-17T02:23:41.495 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.491+0000 7f5f6e4d4640 1 -- 172.21.15.17:0/4236648644 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f68068c70 con 0x7f5f680a5f50 2024-04-17T02:23:41.496 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.492+0000 7f5f64ff9640 1 -- 172.21.15.17:0/4236648644 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 10) ==== 134976+0+0 (secure 0 0 0) 0x7f5f5c01a070 con 0x7f5f680a5f50 2024-04-17T02:23:41.496 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.492+0000 7f5f64ff9640 20 mgrc handle_mgr_map mgrmap(e 10) 2024-04-17T02:23:41.496 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.493+0000 7f5f64ff9640 4 mgrc handle_mgr_map Got map version 10 2024-04-17T02:23:41.496 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.493+0000 7f5f64ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] 2024-04-17T02:23:41.496 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.493+0000 7f5f64ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] 2024-04-17T02:23:41.496 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.493+0000 7f5f64ff9640 1 --2- 172.21.15.17:0/4236648644 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7f5f5409f590 0x7f5f540a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:41.496 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.493+0000 7f5f67fff640 1 --2- 172.21.15.17:0/4236648644 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7f5f5409f590 0x7f5f540a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:41.496 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.493+0000 7f5f64ff9640 1 -- 172.21.15.17:0/4236648644 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 5166+0+0 (secure 0 0 0) 0x7f5f5c0c9780 con 0x7f5f680a5f50 2024-04-17T02:23:41.496 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.493+0000 7f5f67fff640 1 --2- 172.21.15.17:0/4236648644 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7f5f5409f590 0x7f5f540a1a50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5f5800aae0 tx=0x7f5f58008040 comp rx=0 tx=0).ready entity=mgr.4689 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:41.498 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.497+0000 7f5f64ff9640 1 -- 172.21.15.17:0/4236648644 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f5f5c0984b0 con 0x7f5f680a5f50 2024-04-17T02:23:41.725 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:41.724+0000 7f5f6e4d4640 1 -- 172.21.15.17:0/4236648644 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "mgr module disable", "module": "localpool"} v 0) -- 0x7f5f680728b0 con 0x7f5f680a5f50 2024-04-17T02:23:42.211 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:42.210+0000 7f5f64ff9640 1 -- 172.21.15.17:0/4236648644 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mgrmap(e 11) ==== 135019+0+0 (secure 0 0 0) 0x7f5f5c094390 con 0x7f5f680a5f50 2024-04-17T02:23:42.211 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:42.210+0000 7f5f64ff9640 20 mgrc handle_mgr_map mgrmap(e 11) 2024-04-17T02:23:42.211 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:42.210+0000 7f5f64ff9640 4 mgrc handle_mgr_map Got map version 11 2024-04-17T02:23:42.212 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:42.210+0000 7f5f64ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] 2024-04-17T02:23:42.212 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:42.210+0000 7f5f64ff9640 1 -- 172.21.15.17:0/4236648644 <== mon.2 v2:172.21.15.17:3301/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "localpool"}]=0 v11) ==== 89+0+0 (secure 0 0 0) 0x7f5f5c04caa0 con 0x7f5f680a5f50 2024-04-17T02:23:42.239 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:42.238+0000 7f5f67fff640 1 -- 172.21.15.17:0/4236648644 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7f5f5409f590 msgr2=0x7f5f540a1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-04-17T02:23:42.240 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:42.238+0000 7f5f67fff640 1 -- 172.21.15.17:0/4236648644 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7f5f5409f590 msgr2=0x7f5f540a1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-17T02:23:42.240 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:42.238+0000 7f5f67fff640 1 --2- 172.21.15.17:0/4236648644 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7f5f5409f590 0x7f5f540a1a50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5f5800aae0 tx=0x7f5f58008040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T02:23:42.240 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:42.238+0000 7f5f67fff640 1 --2- 172.21.15.17:0/4236648644 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7f5f5409f590 0x7f5f540a1a50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5f5800aae0 tx=0x7f5f58008040 comp rx=0 tx=0).stop 2024-04-17T02:23:42.240 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:42.238+0000 7f5f64ff9640 4 mgrc ms_handle_reset ms_handle_reset con 0x7f5f5409f590 2024-04-17T02:23:42.240 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:42.238+0000 7f5f64ff9640 4 mgrc reconnect Terminating session with v2:172.21.15.17:6808/2667788284 2024-04-17T02:23:42.240 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:42.238+0000 7f5f64ff9640 1 -- 172.21.15.17:0/4236648644 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7f5f5409f590 msgr2=0x7f5f540a1a50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-17T02:23:42.240 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:42.238+0000 7f5f64ff9640 1 --2- 172.21.15.17:0/4236648644 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7f5f5409f590 0x7f5f540a1a50 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:42.240 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:42.238+0000 7f5f64ff9640 4 mgrc reconnect waiting to retry connect until 604.758514s 2024-04-17T02:23:42.389 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:42.388+0000 7f5f6e4d4640 1 -- 172.21.15.17:0/4236648644 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "mgr module disable", "module": "localpool"} v 0) -- 0x7f5f400050a0 con 0x7f5f680a5f50 2024-04-17T02:23:42.494 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:42.493+0000 7f5f4effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] 2024-04-17T02:23:42.494 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:42.493+0000 7f5f4effd640 1 --2- 172.21.15.17:0/4236648644 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7f5f5409f590 0x7f5f6806e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:42.494 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:42.493+0000 7f5f67fff640 1 -- 172.21.15.17:0/4236648644 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7f5f5409f590 msgr2=0x7f5f6806e500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6808/2667788284 2024-04-17T02:23:42.494 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:42.493+0000 7f5f67fff640 1 --2- 172.21.15.17:0/4236648644 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7f5f5409f590 0x7f5f6806e500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T02:23:42.616 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:42.616+0000 7fc2dc442040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-17T02:23:42.617 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:42.616+0000 7fbaf4841040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-17T02:23:42.629 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:42.628+0000 7f2c4bc41040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-17T02:23:42.665 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:42.664+0000 7fc2dc442040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-17T02:23:42.665 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:42.664+0000 7fbaf4841040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-17T02:23:42.677 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:42.676+0000 7f2c4bc41040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-17T02:23:42.694 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:42.694+0000 7f5f67fff640 1 -- 172.21.15.17:0/4236648644 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7f5f5409f590 msgr2=0x7f5f6806e500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6808/2667788284 2024-04-17T02:23:42.695 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:42.694+0000 7f5f67fff640 1 --2- 172.21.15.17:0/4236648644 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7f5f5409f590 0x7f5f6806e500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T02:23:43.056 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:43.055+0000 7fc2dc442040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-17T02:23:43.057 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:43.055+0000 7fbaf4841040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-17T02:23:43.079 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:43.078+0000 7f2c4bc41040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-17T02:23:43.096 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.095+0000 7f5f67fff640 1 -- 172.21.15.17:0/4236648644 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7f5f5409f590 msgr2=0x7f5f6806e500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6808/2667788284 2024-04-17T02:23:43.096 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.095+0000 7f5f67fff640 1 --2- 172.21.15.17:0/4236648644 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7f5f5409f590 0x7f5f6806e500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T02:23:43.102 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:43.101+0000 7fc2dc442040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-17T02:23:43.102 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:43.101+0000 7fbaf4841040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-17T02:23:43.125 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:43.124+0000 7f2c4bc41040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-17T02:23:43.145 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:43.144+0000 7fc2dc442040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-17T02:23:43.146 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:43.144+0000 7fbaf4841040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-17T02:23:43.170 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:43.169+0000 7f2c4bc41040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-17T02:23:43.199 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:43.198+0000 7fc2dc442040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-17T02:23:43.199 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:43.198+0000 7fbaf4841040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-17T02:23:43.213 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.211+0000 7f5f64ff9640 1 -- 172.21.15.17:0/4236648644 <== mon.2 v2:172.21.15.17:3301/0 9 ==== mgrmap(e 12) ==== 135019+0+0 (secure 0 0 0) 0x7f5f5c03b0d0 con 0x7f5f680a5f50 2024-04-17T02:23:43.213 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.211+0000 7f5f64ff9640 20 mgrc handle_mgr_map mgrmap(e 12) 2024-04-17T02:23:43.213 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.212+0000 7f5f64ff9640 4 mgrc handle_mgr_map Got map version 12 2024-04-17T02:23:43.213 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.212+0000 7f5f64ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] 2024-04-17T02:23:43.213 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.212+0000 7f5f64ff9640 1 -- 172.21.15.17:0/4236648644 <== mon.2 v2:172.21.15.17:3301/0 10 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "localpool"}]=0 module 'localpool' is already disabled v12) ==== 127+0+0 (secure 0 0 0) 0x7f5f5c0cf250 con 0x7f5f680a5f50 2024-04-17T02:23:43.213 INFO:tasks.workunit.client.0.smithi017.stderr:module 'localpool' is already disabled 2024-04-17T02:23:43.217 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.215+0000 7f5f6e4d4640 10 mgrc shutdown 2024-04-17T02:23:43.217 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.215+0000 7f5f6e4d4640 1 -- 172.21.15.17:0/4236648644 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7f5f5409f590 msgr2=0x7f5f6806e500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-17T02:23:43.217 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.215+0000 7f5f6e4d4640 1 --2- 172.21.15.17:0/4236648644 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7f5f5409f590 0x7f5f6806e500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:43.217 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.215+0000 7f5f6e4d4640 1 -- 172.21.15.17:0/4236648644 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f5f680a5f50 msgr2=0x7f5f680b72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:43.217 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.215+0000 7f5f6e4d4640 1 --2- 172.21.15.17:0/4236648644 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f5f680a5f50 0x7f5f680b72c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c00ec10 tx=0x7f5f5c00c520 comp rx=0 tx=0).stop 2024-04-17T02:23:43.217 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.215+0000 7f5f6e4d4640 1 -- 172.21.15.17:0/4236648644 shutdown_connections 2024-04-17T02:23:43.217 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.215+0000 7f5f6e4d4640 1 --2- 172.21.15.17:0/4236648644 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7f5f5409f590 0x7f5f6806e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:43.217 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.215+0000 7f5f6e4d4640 1 --2- 172.21.15.17:0/4236648644 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5f680a81f0 0x7f5f680b8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:43.217 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.215+0000 7f5f6e4d4640 1 --2- 172.21.15.17:0/4236648644 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f5f680a5f50 0x7f5f680b72c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:43.217 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.215+0000 7f5f6e4d4640 1 --2- 172.21.15.17:0/4236648644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f680a58e0 0x7f5f6813bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:43.218 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.215+0000 7f5f6e4d4640 1 -- 172.21.15.17:0/4236648644 >> 172.21.15.17:0/4236648644 conn(0x7f5f68074820 msgr2=0x7f5f681442f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:23:43.218 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.215+0000 7f5f6e4d4640 1 -- 172.21.15.17:0/4236648644 shutdown_connections 2024-04-17T02:23:43.218 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.215+0000 7f5f6e4d4640 1 -- 172.21.15.17:0/4236648644 wait complete. 2024-04-17T02:23:43.230 INFO:tasks.workunit.client.0.smithi017.stderr:++ ceph osd pool ls 2024-04-17T02:23:43.230 INFO:tasks.workunit.client.0.smithi017.stderr:++ grep '^by-host-' 2024-04-17T02:23:43.237 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:43.236+0000 7f2c4bc41040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-17T02:23:43.245 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:43.244+0000 7fbaf4841040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-17T02:23:43.245 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:43.245+0000 7fc2dc442040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-17T02:23:43.282 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:43.281+0000 7f2c4bc41040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-17T02:23:43.311 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.310+0000 7eff08b7a640 1 Processor -- start 2024-04-17T02:23:43.311 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.310+0000 7eff08b7a640 1 -- start start 2024-04-17T02:23:43.313 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.311+0000 7eff08b7a640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7eff040a5f10 0x7eff04072fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:43.313 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.311+0000 7eff08b7a640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff04072b00 con 0x7eff040a5870 2024-04-17T02:23:43.313 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.311+0000 7eff08b7a640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff041454a0 con 0x7eff04073520 2024-04-17T02:23:43.313 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.311+0000 7eff08b7a640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7eff04145170 con 0x7eff040a5f10 2024-04-17T02:23:43.313 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.311+0000 7eff0259c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7eff040a5f10 0x7eff04072fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:43.313 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.311+0000 7eff02d9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7eff040a5870 0x7eff0414fa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:57786/0 (socket says 172.21.15.17:57786) 2024-04-17T02:23:43.313 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.311+0000 7eff02d9d640 1 -- 172.21.15.17:0/429996735 learned_addr learned my addr 172.21.15.17:0/429996735 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:23:43.313 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.311+0000 7eff0259c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7eff040a5f10 0x7eff04072fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58484/0 (socket says 172.21.15.17:58484) 2024-04-17T02:23:43.313 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.312+0000 7eff0259c640 1 -- 172.21.15.17:0/429996735 >> v1:172.21.15.122:6789/0 conn(0x7eff04073520 legacy=0x7eff04145760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:43.313 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.312+0000 7eff0259c640 1 -- 172.21.15.17:0/429996735 >> v1:172.21.15.17:6789/0 conn(0x7eff040a5870 legacy=0x7eff0414fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:43.313 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.312+0000 7eff0259c640 1 -- 172.21.15.17:0/429996735 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff040a62f0 con 0x7eff040a5f10 2024-04-17T02:23:43.315 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.312+0000 7eff0259c640 1 --2- 172.21.15.17:0/429996735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff040a5f10 0x7eff04072fe0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efef40097a0 tx=0x7efef402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19d4aaee4af1d097 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:43.315 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.312+0000 7eff0159a640 1 -- 172.21.15.17:0/429996735 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef4035020 con 0x7eff040a5f10 2024-04-17T02:23:43.315 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.312+0000 7eff0159a640 1 -- 172.21.15.17:0/429996735 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efef4031830 con 0x7eff040a5f10 2024-04-17T02:23:43.315 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.312+0000 7eff0159a640 1 -- 172.21.15.17:0/429996735 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef4031c00 con 0x7eff040a5f10 2024-04-17T02:23:43.315 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.313+0000 7eff08b7a640 1 -- 172.21.15.17:0/429996735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff040a5f10 msgr2=0x7eff04072fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:43.315 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.313+0000 7eff08b7a640 1 --2- 172.21.15.17:0/429996735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff040a5f10 0x7eff04072fe0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efef40097a0 tx=0x7efef402b8d0 comp rx=0 tx=0).stop 2024-04-17T02:23:43.315 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.313+0000 7eff08b7a640 1 -- 172.21.15.17:0/429996735 shutdown_connections 2024-04-17T02:23:43.315 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.313+0000 7eff08b7a640 1 --2- 172.21.15.17:0/429996735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff040a5f10 0x7eff04072fe0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:43.315 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.313+0000 7eff08b7a640 1 -- 172.21.15.17:0/429996735 >> 172.21.15.17:0/429996735 conn(0x7eff040a7c50 msgr2=0x7eff040a8060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:23:43.315 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.313+0000 7eff08b7a640 1 -- 172.21.15.17:0/429996735 shutdown_connections 2024-04-17T02:23:43.316 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.313+0000 7eff08b7a640 1 -- 172.21.15.17:0/429996735 wait complete. 2024-04-17T02:23:43.318 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.314+0000 7eff08b7a640 1 Processor -- start 2024-04-17T02:23:43.318 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.314+0000 7eff08b7a640 1 -- start start 2024-04-17T02:23:43.318 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.315+0000 7eff08b7a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff040a5870 0x7eff04148b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:43.318 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.315+0000 7eff08b7a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff040a5f10 0x7eff0409e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:43.318 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.315+0000 7eff08b7a640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7eff041ddf10 0x7eff041d1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:43.318 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.315+0000 7eff08b7a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7eff04145ff0 con 0x7eff040a5870 2024-04-17T02:23:43.318 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.315+0000 7eff08b7a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7eff04145e70 con 0x7eff040a5f10 2024-04-17T02:23:43.318 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.315+0000 7eff08b7a640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7eff040a7540 con 0x7eff041ddf10 2024-04-17T02:23:43.318 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.315+0000 7eff0259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff040a5870 0x7eff04148b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:43.319 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.315+0000 7eff0259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff040a5870 0x7eff04148b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58494/0 (socket says 172.21.15.17:58494) 2024-04-17T02:23:43.319 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.315+0000 7eff0259c640 1 -- 172.21.15.17:0/3681776345 learned_addr learned my addr 172.21.15.17:0/3681776345 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:23:43.319 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.315+0000 7eff02d9d640 1 --2- 172.21.15.17:0/3681776345 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7eff041ddf10 0x7eff041d1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:43.319 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.315+0000 7eff01d9b640 1 --2- 172.21.15.17:0/3681776345 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff040a5f10 0x7eff0409e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:43.319 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.315+0000 7eff0259c640 1 -- 172.21.15.17:0/3681776345 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7eff041ddf10 msgr2=0x7eff041d1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:43.319 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.315+0000 7eff0259c640 1 --2- 172.21.15.17:0/3681776345 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7eff041ddf10 0x7eff041d1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:43.319 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.315+0000 7eff0259c640 1 -- 172.21.15.17:0/3681776345 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff040a5f10 msgr2=0x7eff0409e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:43.319 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.315+0000 7eff0259c640 1 --2- 172.21.15.17:0/3681776345 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff040a5f10 0x7eff0409e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:43.319 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.316+0000 7eff0259c640 1 -- 172.21.15.17:0/3681776345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff041cfae0 con 0x7eff040a5870 2024-04-17T02:23:43.319 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.316+0000 7eff02d9d640 1 --2- 172.21.15.17:0/3681776345 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7eff041ddf10 0x7eff041d1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:23:43.319 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.316+0000 7eff0259c640 1 --2- 172.21.15.17:0/3681776345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff040a5870 0x7eff04148b00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efef4034040 tx=0x7efef40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:43.319 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.316+0000 7efefaffd640 1 -- 172.21.15.17:0/3681776345 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef4040070 con 0x7eff040a5870 2024-04-17T02:23:43.319 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.316+0000 7efefaffd640 1 -- 172.21.15.17:0/3681776345 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efef4039a20 con 0x7eff040a5870 2024-04-17T02:23:43.319 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.316+0000 7eff08b7a640 1 -- 172.21.15.17:0/3681776345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff0409e3a0 con 0x7eff040a5870 2024-04-17T02:23:43.320 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.316+0000 7efefaffd640 1 -- 172.21.15.17:0/3681776345 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef4035040 con 0x7eff040a5870 2024-04-17T02:23:43.320 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.316+0000 7eff08b7a640 1 -- 172.21.15.17:0/3681776345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff041de6c0 con 0x7eff040a5870 2024-04-17T02:23:43.320 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.317+0000 7eff08b7a640 1 -- 172.21.15.17:0/3681776345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff040732e0 con 0x7eff040a5870 2024-04-17T02:23:43.320 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.319+0000 7efefaffd640 1 -- 172.21.15.17:0/3681776345 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 12) ==== 135019+0+0 (secure 0 0 0) 0x7efef4038020 con 0x7eff040a5870 2024-04-17T02:23:43.321 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.319+0000 7efefaffd640 20 mgrc handle_mgr_map mgrmap(e 12) 2024-04-17T02:23:43.321 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.319+0000 7efefaffd640 4 mgrc handle_mgr_map Got map version 12 2024-04-17T02:23:43.321 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.319+0000 7efefaffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] 2024-04-17T02:23:43.321 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.319+0000 7efefaffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] 2024-04-17T02:23:43.321 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.319+0000 7efefaffd640 1 --2- 172.21.15.17:0/3681776345 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7efee409f5a0 0x7efee40a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:43.321 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.320+0000 7eff01d9b640 1 -- 172.21.15.17:0/3681776345 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7efee409f5a0 msgr2=0x7efee40a1a60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6808/2667788284 2024-04-17T02:23:43.321 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.320+0000 7efefaffd640 1 -- 172.21.15.17:0/3681776345 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5239+0+0 (secure 0 0 0) 0x7efef40eb900 con 0x7eff040a5870 2024-04-17T02:23:43.321 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.320+0000 7eff01d9b640 1 --2- 172.21.15.17:0/3681776345 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7efee409f5a0 0x7efee40a1a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T02:23:43.324 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.323+0000 7efefaffd640 1 -- 172.21.15.17:0/3681776345 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7eff040732e0 con 0x7eff040a5870 2024-04-17T02:23:43.360 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:43.359+0000 7fc2dc442040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-17T02:23:43.361 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:43.360+0000 7fbaf4841040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-17T02:23:43.404 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:43.403+0000 7f2c4bc41040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-17T02:23:43.415 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:43.414+0000 7fc2dc442040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-17T02:23:43.415 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:43.414+0000 7fbaf4841040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-17T02:23:43.458 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:43.457+0000 7fc2dc442040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-17T02:23:43.458 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:43.457+0000 7fbaf4841040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-17T02:23:43.459 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:43.459+0000 7f2c4bc41040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-17T02:23:43.504 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:43.503+0000 7f2c4bc41040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-17T02:23:43.506 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.506+0000 7eff08b7a640 1 -- 172.21.15.17:0/3681776345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool ls"} v 0) -- 0x7eff04068c70 con 0x7eff040a5870 2024-04-17T02:23:43.507 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:43.506+0000 7fc2dc442040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-17T02:23:43.507 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.506+0000 7efefaffd640 1 -- 172.21.15.17:0/3681776345 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v28) ==== 59+0+55 (secure 0 0 0) 0x7efef40ba420 con 0x7eff040a5870 2024-04-17T02:23:43.507 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:43.506+0000 7fbaf4841040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-17T02:23:43.521 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.521+0000 7eff01d9b640 1 -- 172.21.15.17:0/3681776345 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7efee409f5a0 msgr2=0x7efee40a1a60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6808/2667788284 2024-04-17T02:23:43.521 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.521+0000 7eff01d9b640 1 --2- 172.21.15.17:0/3681776345 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7efee409f5a0 0x7efee40a1a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T02:23:43.551 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:43.550+0000 7fc2dc442040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-17T02:23:43.551 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:43.550+0000 7fbaf4841040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-17T02:23:43.555 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:43.554+0000 7f2c4bc41040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-17T02:23:43.600 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:43.599+0000 7f2c4bc41040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-17T02:23:43.616 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.615+0000 7eff08b7a640 1 -- 172.21.15.17:0/3681776345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool ls"} v 0) -- 0x7eff040a72a0 con 0x7eff040a5870 2024-04-17T02:23:43.616 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.616+0000 7efefaffd640 1 -- 172.21.15.17:0/3681776345 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v28) ==== 59+0+55 (secure 0 0 0) 0x7efef40b9d20 con 0x7eff040a5870 2024-04-17T02:23:43.619 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.618+0000 7eff08b7a640 10 mgrc shutdown 2024-04-17T02:23:43.619 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.618+0000 7eff08b7a640 1 -- 172.21.15.17:0/3681776345 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7efee409f5a0 msgr2=0x7efee40a1a60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-17T02:23:43.619 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.618+0000 7eff08b7a640 1 --2- 172.21.15.17:0/3681776345 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7efee409f5a0 0x7efee40a1a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:43.620 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.618+0000 7eff08b7a640 1 -- 172.21.15.17:0/3681776345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff040a5870 msgr2=0x7eff04148b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:43.620 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.618+0000 7eff08b7a640 1 --2- 172.21.15.17:0/3681776345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff040a5870 0x7eff04148b00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efef4034040 tx=0x7efef40046c0 comp rx=0 tx=0).stop 2024-04-17T02:23:43.620 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.618+0000 7eff08b7a640 1 -- 172.21.15.17:0/3681776345 shutdown_connections 2024-04-17T02:23:43.620 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.618+0000 7eff08b7a640 1 --2- 172.21.15.17:0/3681776345 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7efee409f5a0 0x7efee40a1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:43.620 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.618+0000 7eff08b7a640 1 --2- 172.21.15.17:0/3681776345 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7eff041ddf10 0x7eff041d1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:43.620 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.618+0000 7eff08b7a640 1 --2- 172.21.15.17:0/3681776345 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff040a5f10 0x7eff0409e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:43.620 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.618+0000 7eff08b7a640 1 --2- 172.21.15.17:0/3681776345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff040a5870 0x7eff04148b00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:43.620 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.618+0000 7eff08b7a640 1 -- 172.21.15.17:0/3681776345 >> 172.21.15.17:0/3681776345 conn(0x7eff040a7c50 msgr2=0x7eff04145760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:23:43.620 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.618+0000 7eff08b7a640 1 -- 172.21.15.17:0/3681776345 shutdown_connections 2024-04-17T02:23:43.620 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.618+0000 7eff08b7a640 1 -- 172.21.15.17:0/3681776345 wait complete. 2024-04-17T02:23:43.629 INFO:tasks.workunit.client.0.smithi017.stderr:+ for p in `ceph osd pool ls | grep '^by-host-'` 2024-04-17T02:23:43.629 INFO:tasks.workunit.client.0.smithi017.stderr:+ ceph osd pool rm by-host-smithi017 by-host-smithi017 --yes-i-really-really-mean-it 2024-04-17T02:23:43.713 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.712+0000 7fa29f00e640 1 Processor -- start 2024-04-17T02:23:43.713 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.712+0000 7fa29f00e640 1 -- start start 2024-04-17T02:23:43.715 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.713+0000 7fa29f00e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa2980a42e0 0x7fa298141bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:43.715 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.713+0000 7fa29f00e640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa2980a99c0 0x7fa29814c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:43.715 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.713+0000 7fa29f00e640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2980a6900 con 0x7fa2980a9060 2024-04-17T02:23:43.715 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.713+0000 7fa29f00e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fa298142240 con 0x7fa2980a42e0 2024-04-17T02:23:43.715 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.713+0000 7fa29f00e640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fa298142500 con 0x7fa2980a99c0 2024-04-17T02:23:43.715 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.713+0000 7fa29cdaa640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa2980a42e0 0x7fa298141bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:43.715 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.713+0000 7fa29cdaa640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa2980a42e0 0x7fa298141bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58502/0 (socket says 172.21.15.17:58502) 2024-04-17T02:23:43.715 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.713+0000 7fa29cdaa640 1 -- 172.21.15.17:0/4288671453 learned_addr learned my addr 172.21.15.17:0/4288671453 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:23:43.716 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.713+0000 7fa29d5ab640 1 --2- 172.21.15.17:0/4288671453 >> v2:172.21.15.122:3300/0 conn(0x7fa2980a99c0 0x7fa29814c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:43.716 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.713+0000 7fa29cdaa640 1 -- 172.21.15.17:0/4288671453 >> v2:172.21.15.122:3300/0 conn(0x7fa2980a99c0 msgr2=0x7fa29814c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:23:43.716 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.713+0000 7fa29cdaa640 1 --2- 172.21.15.17:0/4288671453 >> v2:172.21.15.122:3300/0 conn(0x7fa2980a99c0 0x7fa29814c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:43.716 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.713+0000 7fa29cdaa640 1 -- 172.21.15.17:0/4288671453 >> v1:172.21.15.122:6789/0 conn(0x7fa2980a9060 legacy=0x7fa2980b7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:43.716 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.713+0000 7fa29cdaa640 1 -- 172.21.15.17:0/4288671453 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2980a8b60 con 0x7fa2980a42e0 2024-04-17T02:23:43.716 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.714+0000 7fa29cdaa640 1 --2- 172.21.15.17:0/4288671453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2980a42e0 0x7fa298141bb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa29813c250 tx=0x7fa28c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd55a5080e37dd5c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:43.716 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.714+0000 7fa2977fe640 1 -- 172.21.15.17:0/4288671453 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c035020 con 0x7fa2980a42e0 2024-04-17T02:23:43.716 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.714+0000 7fa2977fe640 1 -- 172.21.15.17:0/4288671453 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa28c031870 con 0x7fa2980a42e0 2024-04-17T02:23:43.716 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.714+0000 7fa2977fe640 1 -- 172.21.15.17:0/4288671453 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c031c40 con 0x7fa2980a42e0 2024-04-17T02:23:43.718 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.715+0000 7fa29f00e640 1 -- 172.21.15.17:0/4288671453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2980a42e0 msgr2=0x7fa298141bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:43.719 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.715+0000 7fa29f00e640 1 --2- 172.21.15.17:0/4288671453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2980a42e0 0x7fa298141bb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa29813c250 tx=0x7fa28c02b910 comp rx=0 tx=0).stop 2024-04-17T02:23:43.719 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.715+0000 7fa29f00e640 1 -- 172.21.15.17:0/4288671453 shutdown_connections 2024-04-17T02:23:43.719 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.715+0000 7fa29f00e640 1 --2- 172.21.15.17:0/4288671453 >> v2:172.21.15.122:3300/0 conn(0x7fa2980a99c0 0x7fa29814c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:43.719 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.715+0000 7fa29f00e640 1 --2- 172.21.15.17:0/4288671453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2980a42e0 0x7fa298141bb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:43.719 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.715+0000 7fa29f00e640 1 -- 172.21.15.17:0/4288671453 >> 172.21.15.17:0/4288671453 conn(0x7fa298074530 msgr2=0x7fa298074940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:23:43.719 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.715+0000 7fa29f00e640 1 -- 172.21.15.17:0/4288671453 shutdown_connections 2024-04-17T02:23:43.719 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.715+0000 7fa29f00e640 1 -- 172.21.15.17:0/4288671453 wait complete. 2024-04-17T02:23:43.719 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.716+0000 7fa29f00e640 1 Processor -- start 2024-04-17T02:23:43.719 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.716+0000 7fa29f00e640 1 -- start start 2024-04-17T02:23:43.719 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.717+0000 7fa29f00e640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fa2980a42e0 0x7fa29806b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:43.720 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.717+0000 7fa29f00e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2980a9060 0x7fa29813ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:43.720 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.717+0000 7fa29f00e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2980a99c0 0x7fa29813ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:43.720 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.717+0000 7fa29f00e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa2980a9e10 con 0x7fa2980a9060 2024-04-17T02:23:43.720 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.717+0000 7fa29f00e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa2980a94d0 con 0x7fa2980a99c0 2024-04-17T02:23:43.720 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.717+0000 7fa29f00e640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fa2980a9f90 con 0x7fa2980a42e0 2024-04-17T02:23:43.720 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.717+0000 7fa297fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2980a9060 0x7fa29813ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:43.720 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.717+0000 7fa29cdaa640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fa2980a42e0 0x7fa29806b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:43.720 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.717+0000 7fa297fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2980a9060 0x7fa29813ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58508/0 (socket says 172.21.15.17:58508) 2024-04-17T02:23:43.720 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.717+0000 7fa29cdaa640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fa2980a42e0 0x7fa29806b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:37954/0 (socket says 172.21.15.17:37954) 2024-04-17T02:23:43.720 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.717+0000 7fa297fff640 1 -- 172.21.15.17:0/2025122493 learned_addr learned my addr 172.21.15.17:0/2025122493 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:23:43.720 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.717+0000 7fa29d5ab640 1 --2- 172.21.15.17:0/2025122493 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2980a99c0 0x7fa29813ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:43.720 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.717+0000 7fa297fff640 1 -- 172.21.15.17:0/2025122493 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fa2980a42e0 msgr2=0x7fa29806b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:43.720 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.717+0000 7fa297fff640 1 --2- 172.21.15.17:0/2025122493 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fa2980a42e0 0x7fa29806b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:43.720 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.717+0000 7fa297fff640 1 -- 172.21.15.17:0/2025122493 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2980a99c0 msgr2=0x7fa29813ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:43.720 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.717+0000 7fa297fff640 1 --2- 172.21.15.17:0/2025122493 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2980a99c0 0x7fa29813ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:43.721 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.717+0000 7fa297fff640 1 -- 172.21.15.17:0/2025122493 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa29813f670 con 0x7fa2980a9060 2024-04-17T02:23:43.721 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.717+0000 7fa29cdaa640 1 --2- 172.21.15.17:0/2025122493 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fa2980a42e0 0x7fa29806b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:23:43.721 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.717+0000 7fa297fff640 1 --2- 172.21.15.17:0/2025122493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2980a9060 0x7fa29813ec80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa28400c430 tx=0x7fa28400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:43.721 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.717+0000 7fa2957fa640 1 -- 172.21.15.17:0/2025122493 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2840052d0 con 0x7fa2980a9060 2024-04-17T02:23:43.721 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.717+0000 7fa2957fa640 1 -- 172.21.15.17:0/2025122493 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa284005490 con 0x7fa2980a9060 2024-04-17T02:23:43.721 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.717+0000 7fa29f00e640 1 -- 172.21.15.17:0/2025122493 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa29806b620 con 0x7fa2980a9060 2024-04-17T02:23:43.721 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.717+0000 7fa2957fa640 1 -- 172.21.15.17:0/2025122493 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa284007260 con 0x7fa2980a9060 2024-04-17T02:23:43.721 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.717+0000 7fa29f00e640 1 -- 172.21.15.17:0/2025122493 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa29813f3a0 con 0x7fa2980a9060 2024-04-17T02:23:43.722 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.719+0000 7fa29f00e640 1 -- 172.21.15.17:0/2025122493 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa298068720 con 0x7fa2980a9060 2024-04-17T02:23:43.722 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.720+0000 7fa2957fa640 1 -- 172.21.15.17:0/2025122493 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 12) ==== 135019+0+0 (secure 0 0 0) 0x7fa284007400 con 0x7fa2980a9060 2024-04-17T02:23:43.722 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.720+0000 7fa2957fa640 20 mgrc handle_mgr_map mgrmap(e 12) 2024-04-17T02:23:43.722 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.720+0000 7fa2957fa640 4 mgrc handle_mgr_map Got map version 12 2024-04-17T02:23:43.722 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.720+0000 7fa2957fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] 2024-04-17T02:23:43.722 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.720+0000 7fa2957fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] 2024-04-17T02:23:43.722 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.720+0000 7fa2957fa640 1 --2- 172.21.15.17:0/2025122493 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7fa27c09f5d0 0x7fa27c0a1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:43.723 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.720+0000 7fa29cdaa640 1 -- 172.21.15.17:0/2025122493 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7fa27c09f5d0 msgr2=0x7fa27c0a1a90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6808/2667788284 2024-04-17T02:23:43.723 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.720+0000 7fa2957fa640 1 -- 172.21.15.17:0/2025122493 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5239+0+0 (secure 0 0 0) 0x7fa2840c8e80 con 0x7fa2980a9060 2024-04-17T02:23:43.723 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.720+0000 7fa29cdaa640 1 --2- 172.21.15.17:0/2025122493 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7fa27c09f5d0 0x7fa27c0a1a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T02:23:43.725 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.724+0000 7fa2957fa640 1 -- 172.21.15.17:0/2025122493 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fa2980a6900 con 0x7fa2980a9060 2024-04-17T02:23:43.876 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:43.875+0000 7fc2dc442040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-17T02:23:43.877 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:43.876+0000 7fbaf4841040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-17T02:23:43.906 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.905+0000 7fa29f00e640 1 -- 172.21.15.17:0/2025122493 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "by-host-smithi017", "pool2": "by-host-smithi017", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa29813a850 con 0x7fa2980a9060 2024-04-17T02:23:43.922 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.921+0000 7fa29cdaa640 1 -- 172.21.15.17:0/2025122493 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7fa27c09f5d0 msgr2=0x7fa27c0a1a90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6808/2667788284 2024-04-17T02:23:43.922 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:43.921+0000 7fa29cdaa640 1 --2- 172.21.15.17:0/2025122493 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7fa27c09f5d0 0x7fa27c0a1a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T02:23:43.938 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:43.937+0000 7f2c4bc41040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-17T02:23:44.009 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:44.008+0000 7fc2dc442040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-17T02:23:44.009 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:44.008+0000 7fbaf4841040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-17T02:23:44.076 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:44.075+0000 7f2c4bc41040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-17T02:23:44.103 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:44.102+0000 7fc2dc442040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-17T02:23:44.103 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:44.102+0000 7fbaf4841040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-17T02:23:44.147 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:44.146+0000 7fc2dc442040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-17T02:23:44.147 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:44.146+0000 7fbaf4841040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-17T02:23:44.172 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:44.171+0000 7f2c4bc41040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-17T02:23:44.210 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.209+0000 7fa2957fa640 1 -- 172.21.15.17:0/2025122493 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "by-host-smithi017", "pool2": "by-host-smithi017", "yes_i_really_really_mean_it": true}]=0 pool 'by-host-smithi017' removed v29) ==== 187+0+0 (secure 0 0 0) 0x7fa2840973f0 con 0x7fa2980a9060 2024-04-17T02:23:44.221 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:44.220+0000 7f2c4bc41040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-17T02:23:44.261 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:44.261+0000 7fc2dc442040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-17T02:23:44.263 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:44.262+0000 7fbaf4841040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-17T02:23:44.323 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.322+0000 7fa29cdaa640 1 -- 172.21.15.17:0/2025122493 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7fa27c09f5d0 msgr2=0x7fa27c0a1a90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6808/2667788284 2024-04-17T02:23:44.323 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.322+0000 7fa29cdaa640 1 --2- 172.21.15.17:0/2025122493 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7fa27c09f5d0 0x7fa27c0a1a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T02:23:44.349 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.348+0000 7fa29f00e640 1 -- 172.21.15.17:0/2025122493 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "by-host-smithi017", "pool2": "by-host-smithi017", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa2981d0b90 con 0x7fa2980a9060 2024-04-17T02:23:44.350 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.349+0000 7fa2957fa640 1 -- 172.21.15.17:0/2025122493 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "by-host-smithi017", "pool2": "by-host-smithi017", "yes_i_really_really_mean_it": true}]=0 pool 'by-host-smithi017' does not exist v29) ==== 194+0+0 (secure 0 0 0) 0x7fa28409b490 con 0x7fa2980a9060 2024-04-17T02:23:44.350 INFO:tasks.workunit.client.0.smithi017.stderr:pool 'by-host-smithi017' does not exist 2024-04-17T02:23:44.352 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.351+0000 7fa29f00e640 10 mgrc shutdown 2024-04-17T02:23:44.352 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.351+0000 7fa29f00e640 1 -- 172.21.15.17:0/2025122493 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7fa27c09f5d0 msgr2=0x7fa27c0a1a90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-17T02:23:44.352 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.351+0000 7fa29f00e640 1 --2- 172.21.15.17:0/2025122493 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7fa27c09f5d0 0x7fa27c0a1a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:44.352 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.351+0000 7fa29f00e640 1 -- 172.21.15.17:0/2025122493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2980a9060 msgr2=0x7fa29813ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:44.353 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.351+0000 7fa29f00e640 1 --2- 172.21.15.17:0/2025122493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2980a9060 0x7fa29813ec80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa28400c430 tx=0x7fa28400c8f0 comp rx=0 tx=0).stop 2024-04-17T02:23:44.353 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.351+0000 7fa29f00e640 1 -- 172.21.15.17:0/2025122493 shutdown_connections 2024-04-17T02:23:44.353 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.351+0000 7fa29f00e640 1 --2- 172.21.15.17:0/2025122493 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7fa27c09f5d0 0x7fa27c0a1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:44.353 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.351+0000 7fa29f00e640 1 --2- 172.21.15.17:0/2025122493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2980a9060 0x7fa29813ec80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:44.353 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.351+0000 7fa29f00e640 1 --2- 172.21.15.17:0/2025122493 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2980a99c0 0x7fa29813ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:44.353 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.351+0000 7fa29f00e640 1 --2- 172.21.15.17:0/2025122493 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fa2980a42e0 0x7fa29806b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:44.353 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.351+0000 7fa29f00e640 1 -- 172.21.15.17:0/2025122493 >> 172.21.15.17:0/2025122493 conn(0x7fa298074530 msgr2=0x7fa29806df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:23:44.353 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.351+0000 7fa29f00e640 1 -- 172.21.15.17:0/2025122493 shutdown_connections 2024-04-17T02:23:44.353 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.351+0000 7fa29f00e640 1 -- 172.21.15.17:0/2025122493 wait complete. 2024-04-17T02:23:44.355 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:44.354+0000 7f2c4bc41040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-17T02:23:44.355 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:44.355+0000 7fc2dc442040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-17T02:23:44.356 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:44.356+0000 7fbaf4841040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-17T02:23:44.361 INFO:tasks.workunit.client.0.smithi017.stderr:+ ceph config rm mgr mgr/localpool/subtree 2024-04-17T02:23:44.444 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.443+0000 7f1c29fe9640 1 Processor -- start 2024-04-17T02:23:44.445 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.443+0000 7f1c29fe9640 1 -- start start 2024-04-17T02:23:44.448 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.444+0000 7f1c29fe9640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1c2406b450 0x7f1c240a9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:44.448 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.444+0000 7f1c29fe9640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f1c240a8ce0 0x7f1c240ab5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:44.448 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.444+0000 7f1c29fe9640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c240acd90 con 0x7f1c240ac7c0 2024-04-17T02:23:44.448 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.444+0000 7f1c29fe9640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f1c2406b830 con 0x7f1c2406b450 2024-04-17T02:23:44.448 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.444+0000 7f1c29fe9640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f1c240ad050 con 0x7f1c240a8ce0 2024-04-17T02:23:44.448 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.444+0000 7f1c237fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1c2406b450 0x7f1c240a9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:44.449 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.444+0000 7f1c237fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1c2406b450 0x7f1c240a9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58522/0 (socket says 172.21.15.17:58522) 2024-04-17T02:23:44.449 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.444+0000 7f1c22ffd640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f1c240a8ce0 0x7f1c240ab5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:44.449 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.444+0000 7f1c237fe640 1 -- 172.21.15.17:0/4079294850 learned_addr learned my addr 172.21.15.17:0/4079294850 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:23:44.449 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.444+0000 7f1c237fe640 1 -- 172.21.15.17:0/4079294850 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f1c240a8ce0 msgr2=0x7f1c240ab5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:23:44.449 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.444+0000 7f1c237fe640 1 --2- 172.21.15.17:0/4079294850 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f1c240a8ce0 0x7f1c240ab5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:44.449 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.444+0000 7f1c237fe640 1 -- 172.21.15.17:0/4079294850 >> v1:172.21.15.122:6789/0 conn(0x7f1c240ac7c0 legacy=0x7f1c24144750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:44.449 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.444+0000 7f1c237fe640 1 -- 172.21.15.17:0/4079294850 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c240abae0 con 0x7f1c2406b450 2024-04-17T02:23:44.449 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.444+0000 7f1c22ffd640 1 --2- 172.21.15.17:0/4079294850 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f1c240a8ce0 0x7f1c240ab5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:23:44.449 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.445+0000 7f1c237fe640 1 --2- 172.21.15.17:0/4079294850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c2406b450 0x7f1c240a9260 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1c14009870 tx=0x7f1c1402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bad90c351424e3e server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:44.449 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.445+0000 7f1c227fc640 1 -- 172.21.15.17:0/4079294850 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1402f840 con 0x7f1c2406b450 2024-04-17T02:23:44.450 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.445+0000 7f1c227fc640 1 -- 172.21.15.17:0/4079294850 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c1402f9e0 con 0x7f1c2406b450 2024-04-17T02:23:44.450 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.445+0000 7f1c227fc640 1 -- 172.21.15.17:0/4079294850 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1402fdb0 con 0x7f1c2406b450 2024-04-17T02:23:44.450 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.446+0000 7f1c29fe9640 1 -- 172.21.15.17:0/4079294850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c2406b450 msgr2=0x7f1c240a9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:44.450 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.446+0000 7f1c29fe9640 1 --2- 172.21.15.17:0/4079294850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c2406b450 0x7f1c240a9260 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1c14009870 tx=0x7f1c1402ba20 comp rx=0 tx=0).stop 2024-04-17T02:23:44.450 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.446+0000 7f1c29fe9640 1 -- 172.21.15.17:0/4079294850 shutdown_connections 2024-04-17T02:23:44.450 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.446+0000 7f1c29fe9640 1 --2- 172.21.15.17:0/4079294850 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f1c240a8ce0 0x7f1c240ab5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:44.450 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.446+0000 7f1c29fe9640 1 --2- 172.21.15.17:0/4079294850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c2406b450 0x7f1c240a9260 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:44.450 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.446+0000 7f1c29fe9640 1 -- 172.21.15.17:0/4079294850 >> 172.21.15.17:0/4079294850 conn(0x7f1c240a9a70 msgr2=0x7f1c240a9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:23:44.450 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.446+0000 7f1c29fe9640 1 -- 172.21.15.17:0/4079294850 shutdown_connections 2024-04-17T02:23:44.451 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.446+0000 7f1c29fe9640 1 -- 172.21.15.17:0/4079294850 wait complete. 2024-04-17T02:23:44.453 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.448+0000 7f1c29fe9640 1 Processor -- start 2024-04-17T02:23:44.453 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.448+0000 7f1c29fe9640 1 -- start start 2024-04-17T02:23:44.453 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.449+0000 7f1c29fe9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c2406b450 0x7f1c2414e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:44.453 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.449+0000 7f1c29fe9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c240a8ce0 0x7f1c2413a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:44.454 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.449+0000 7f1c29fe9640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f1c240ac7c0 0x7f1c2413ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:44.454 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.449+0000 7f1c29fe9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1c24144fe0 con 0x7f1c240a8ce0 2024-04-17T02:23:44.454 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.449+0000 7f1c29fe9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1c24144e60 con 0x7f1c2406b450 2024-04-17T02:23:44.454 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.449+0000 7f1c29fe9640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f1c2414fa80 con 0x7f1c240ac7c0 2024-04-17T02:23:44.454 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.449+0000 7f1c22ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c240a8ce0 0x7f1c2413a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:44.454 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.449+0000 7f1c237fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c2406b450 0x7f1c2414e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:44.454 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.449+0000 7f1c22ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c240a8ce0 0x7f1c2413a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58538/0 (socket says 172.21.15.17:58538) 2024-04-17T02:23:44.454 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.449+0000 7f1c22ffd640 1 -- 172.21.15.17:0/372701134 learned_addr learned my addr 172.21.15.17:0/372701134 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:23:44.454 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.449+0000 7f1c23fff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f1c240ac7c0 0x7f1c2413ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:44.454 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.449+0000 7f1c22ffd640 1 -- 172.21.15.17:0/372701134 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f1c240ac7c0 msgr2=0x7f1c2413ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:44.454 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.449+0000 7f1c22ffd640 1 --2- 172.21.15.17:0/372701134 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f1c240ac7c0 0x7f1c2413ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:44.454 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.449+0000 7f1c22ffd640 1 -- 172.21.15.17:0/372701134 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c2406b450 msgr2=0x7f1c2414e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:44.454 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.449+0000 7f1c22ffd640 1 --2- 172.21.15.17:0/372701134 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c2406b450 0x7f1c2414e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:44.455 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.449+0000 7f1c22ffd640 1 -- 172.21.15.17:0/372701134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c2414edd0 con 0x7f1c240a8ce0 2024-04-17T02:23:44.455 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.449+0000 7f1c237fe640 1 --2- 172.21.15.17:0/372701134 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c2406b450 0x7f1c2414e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:23:44.455 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.449+0000 7f1c22ffd640 1 --2- 172.21.15.17:0/372701134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c240a8ce0 0x7f1c2413a5f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1c1800ebe0 tx=0x7f1c1800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:44.455 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.450+0000 7f1c0bfff640 1 -- 172.21.15.17:0/372701134 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c18017070 con 0x7f1c240a8ce0 2024-04-17T02:23:44.455 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.450+0000 7f1c0bfff640 1 -- 172.21.15.17:0/372701134 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c1800cc30 con 0x7f1c240a8ce0 2024-04-17T02:23:44.455 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.450+0000 7f1c0bfff640 1 -- 172.21.15.17:0/372701134 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c18013470 con 0x7f1c240a8ce0 2024-04-17T02:23:44.455 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.450+0000 7f1c29fe9640 1 -- 172.21.15.17:0/372701134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c2413b280 con 0x7f1c240a8ce0 2024-04-17T02:23:44.455 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.450+0000 7f1c29fe9640 1 -- 172.21.15.17:0/372701134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c2413e400 con 0x7f1c240a8ce0 2024-04-17T02:23:44.455 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.451+0000 7f1c29fe9640 1 -- 172.21.15.17:0/372701134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c24068c70 con 0x7f1c240a8ce0 2024-04-17T02:23:44.455 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.452+0000 7f1c0bfff640 1 -- 172.21.15.17:0/372701134 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 12) ==== 135019+0+0 (secure 0 0 0) 0x7f1c1801a070 con 0x7f1c240a8ce0 2024-04-17T02:23:44.455 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.452+0000 7f1c0bfff640 20 mgrc handle_mgr_map mgrmap(e 12) 2024-04-17T02:23:44.456 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.453+0000 7f1c0bfff640 4 mgrc handle_mgr_map Got map version 12 2024-04-17T02:23:44.456 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.453+0000 7f1c0bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] 2024-04-17T02:23:44.456 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.453+0000 7f1c0bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] 2024-04-17T02:23:44.456 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.453+0000 7f1c0bfff640 1 --2- 172.21.15.17:0/372701134 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7f1c1009f5a0 0x7f1c100a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:44.457 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.453+0000 7f1c237fe640 1 -- 172.21.15.17:0/372701134 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7f1c1009f5a0 msgr2=0x7f1c100a1a60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6808/2667788284 2024-04-17T02:23:44.457 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.453+0000 7f1c0bfff640 1 -- 172.21.15.17:0/372701134 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4883+0+0 (secure 0 0 0) 0x7f1c180c9a90 con 0x7f1c240a8ce0 2024-04-17T02:23:44.457 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.453+0000 7f1c237fe640 1 --2- 172.21.15.17:0/372701134 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7f1c1009f5a0 0x7f1c100a1a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T02:23:44.457 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:44.455+0000 7f2c4bc41040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-17T02:23:44.457 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.457+0000 7f1c0bfff640 1 -- 172.21.15.17:0/372701134 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f1c180980c0 con 0x7f1c240a8ce0 2024-04-17T02:23:44.512 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:44.510+0000 7fc2dc442040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-17T02:23:44.512 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:44.510+0000 7fbaf4841040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-17T02:23:44.554 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:44.553+0000 7fc2dc442040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-17T02:23:44.554 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:44.553+0000 7fbaf4841040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-17T02:23:44.616 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:44.615+0000 7f2c4bc41040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-17T02:23:44.640 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.639+0000 7f1c29fe9640 1 -- 172.21.15.17:0/372701134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/localpool/subtree"} v 0) -- 0x7f1c240a4580 con 0x7f1c240a8ce0 2024-04-17T02:23:44.643 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.642+0000 7f1c0bfff640 1 -- 172.21.15.17:0/372701134 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/localpool/subtree"}]=0 v8) ==== 104+0+0 (secure 0 0 0) 0x7f1c1809c160 con 0x7f1c240a8ce0 2024-04-17T02:23:44.655 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.654+0000 7f1c237fe640 1 -- 172.21.15.17:0/372701134 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7f1c1009f5a0 msgr2=0x7f1c100a1a60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6808/2667788284 2024-04-17T02:23:44.655 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.654+0000 7f1c237fe640 1 --2- 172.21.15.17:0/372701134 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7f1c1009f5a0 0x7f1c100a1a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T02:23:44.661 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:44.660+0000 7f2c4bc41040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-17T02:23:44.674 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:44.673+0000 7fc2dc442040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-17T02:23:44.676 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:44.675+0000 7fbaf4841040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-17T02:23:44.750 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.749+0000 7f1c29fe9640 1 -- 172.21.15.17:0/372701134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/localpool/subtree"} v 0) -- 0x7f1c240a8ac0 con 0x7f1c240a8ce0 2024-04-17T02:23:44.751 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.750+0000 7f1c0bfff640 1 -- 172.21.15.17:0/372701134 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/localpool/subtree"}]=0 v8) ==== 104+0+0 (secure 0 0 0) 0x7f1c180a0a20 con 0x7f1c240a8ce0 2024-04-17T02:23:44.753 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.751+0000 7f1c29fe9640 10 mgrc shutdown 2024-04-17T02:23:44.753 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.751+0000 7f1c29fe9640 1 -- 172.21.15.17:0/372701134 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7f1c1009f5a0 msgr2=0x7f1c100a1a60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-17T02:23:44.753 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.751+0000 7f1c29fe9640 1 --2- 172.21.15.17:0/372701134 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7f1c1009f5a0 0x7f1c100a1a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:44.753 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.752+0000 7f1c29fe9640 1 -- 172.21.15.17:0/372701134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c240a8ce0 msgr2=0x7f1c2413a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:44.753 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.752+0000 7f1c29fe9640 1 --2- 172.21.15.17:0/372701134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c240a8ce0 0x7f1c2413a5f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1c1800ebe0 tx=0x7f1c1800c520 comp rx=0 tx=0).stop 2024-04-17T02:23:44.753 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.752+0000 7f1c29fe9640 1 -- 172.21.15.17:0/372701134 shutdown_connections 2024-04-17T02:23:44.753 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.752+0000 7f1c29fe9640 1 --2- 172.21.15.17:0/372701134 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7f1c1009f5a0 0x7f1c100a1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:44.754 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.752+0000 7f1c29fe9640 1 --2- 172.21.15.17:0/372701134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c240a8ce0 0x7f1c2413a5f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:44.754 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.752+0000 7f1c29fe9640 1 --2- 172.21.15.17:0/372701134 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f1c240ac7c0 0x7f1c2413ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:44.754 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.752+0000 7f1c29fe9640 1 --2- 172.21.15.17:0/372701134 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c2406b450 0x7f1c2414e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:44.754 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.752+0000 7f1c29fe9640 1 -- 172.21.15.17:0/372701134 >> 172.21.15.17:0/372701134 conn(0x7f1c240a9a70 msgr2=0x7f1c241425e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:23:44.754 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.752+0000 7f1c29fe9640 1 -- 172.21.15.17:0/372701134 shutdown_connections 2024-04-17T02:23:44.754 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.752+0000 7f1c29fe9640 1 -- 172.21.15.17:0/372701134 wait complete. 2024-04-17T02:23:44.762 INFO:tasks.workunit.client.0.smithi017.stderr:+ ceph config rm mgr mgr/localpool/failure_domain 2024-04-17T02:23:44.788 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:44.787+0000 7f2c4bc41040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-17T02:23:44.844 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.843+0000 7fcb99acc640 1 Processor -- start 2024-04-17T02:23:44.844 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.843+0000 7fcb99acc640 1 -- start start 2024-04-17T02:23:44.847 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.844+0000 7fcb99acc640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fcb9406b450 0x7fcb940a9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:44.847 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.844+0000 7fcb99acc640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcb940a8ce0 0x7fcb940ab5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:44.847 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.844+0000 7fcb99acc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fcb940ac7c0 0x7fcb94144750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:44.847 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.844+0000 7fcb99acc640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fcb9406b830 con 0x7fcb940ac7c0 2024-04-17T02:23:44.847 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.844+0000 7fcb99acc640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fcb940acd90 con 0x7fcb9406b450 2024-04-17T02:23:44.847 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.844+0000 7fcb99acc640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fcb940ad050 con 0x7fcb940a8ce0 2024-04-17T02:23:44.847 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.844+0000 7fcb92ffd640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcb940a8ce0 0x7fcb940ab5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:44.847 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.844+0000 7fcb92ffd640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcb940a8ce0 0x7fcb940ab5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:38000/0 (socket says 172.21.15.17:38000) 2024-04-17T02:23:44.847 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.844+0000 7fcb92ffd640 1 -- 172.21.15.17:0/2394266001 learned_addr learned my addr 172.21.15.17:0/2394266001 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:23:44.848 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.844+0000 7fcb93fff640 1 --2- 172.21.15.17:0/2394266001 >> v2:172.21.15.17:3300/0 conn(0x7fcb940ac7c0 0x7fcb94144750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:44.848 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.844+0000 7fcb937fe640 1 --2- 172.21.15.17:0/2394266001 >> v2:172.21.15.122:3300/0 conn(0x7fcb9406b450 0x7fcb940a9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:44.848 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.844+0000 7fcb92ffd640 1 -- 172.21.15.17:0/2394266001 >> v2:172.21.15.122:3300/0 conn(0x7fcb9406b450 msgr2=0x7fcb940a9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:23:44.848 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.844+0000 7fcb92ffd640 1 --2- 172.21.15.17:0/2394266001 >> v2:172.21.15.122:3300/0 conn(0x7fcb9406b450 0x7fcb940a9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:44.848 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.844+0000 7fcb92ffd640 1 -- 172.21.15.17:0/2394266001 >> v2:172.21.15.17:3300/0 conn(0x7fcb940ac7c0 msgr2=0x7fcb94144750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:23:44.848 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.844+0000 7fcb92ffd640 1 --2- 172.21.15.17:0/2394266001 >> v2:172.21.15.17:3300/0 conn(0x7fcb940ac7c0 0x7fcb94144750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:44.848 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.844+0000 7fcb92ffd640 1 -- 172.21.15.17:0/2394266001 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb940abae0 con 0x7fcb940a8ce0 2024-04-17T02:23:44.848 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.844+0000 7fcb93fff640 1 --2- 172.21.15.17:0/2394266001 >> v2:172.21.15.17:3300/0 conn(0x7fcb940ac7c0 0x7fcb94144750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:23:44.848 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.845+0000 7fcb92ffd640 1 --2- 172.21.15.17:0/2394266001 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcb940a8ce0 0x7fcb940ab5a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcb9406c4e0 tx=0x7fcb8802b990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fe566c83be9c8d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:44.848 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.845+0000 7fcb927fc640 1 -- 172.21.15.17:0/2394266001 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb88034070 con 0x7fcb940a8ce0 2024-04-17T02:23:44.848 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.845+0000 7fcb927fc640 1 -- 172.21.15.17:0/2394266001 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb88030850 con 0x7fcb940a8ce0 2024-04-17T02:23:44.849 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.845+0000 7fcb927fc640 1 -- 172.21.15.17:0/2394266001 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb88030c20 con 0x7fcb940a8ce0 2024-04-17T02:23:44.849 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.846+0000 7fcb99acc640 1 -- 172.21.15.17:0/2394266001 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcb940a8ce0 msgr2=0x7fcb940ab5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:44.849 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.846+0000 7fcb99acc640 1 --2- 172.21.15.17:0/2394266001 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcb940a8ce0 0x7fcb940ab5a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcb9406c4e0 tx=0x7fcb8802b990 comp rx=0 tx=0).stop 2024-04-17T02:23:44.849 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.846+0000 7fcb99acc640 1 -- 172.21.15.17:0/2394266001 shutdown_connections 2024-04-17T02:23:44.849 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.846+0000 7fcb99acc640 1 --2- 172.21.15.17:0/2394266001 >> v2:172.21.15.17:3300/0 conn(0x7fcb940ac7c0 0x7fcb94144750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:44.849 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.846+0000 7fcb99acc640 1 --2- 172.21.15.17:0/2394266001 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcb940a8ce0 0x7fcb940ab5a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:44.849 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.846+0000 7fcb99acc640 1 --2- 172.21.15.17:0/2394266001 >> v2:172.21.15.122:3300/0 conn(0x7fcb9406b450 0x7fcb940a9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:44.849 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.846+0000 7fcb99acc640 1 -- 172.21.15.17:0/2394266001 >> 172.21.15.17:0/2394266001 conn(0x7fcb940a9a70 msgr2=0x7fcb940a9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:23:44.849 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.846+0000 7fcb99acc640 1 -- 172.21.15.17:0/2394266001 shutdown_connections 2024-04-17T02:23:44.849 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.846+0000 7fcb99acc640 1 -- 172.21.15.17:0/2394266001 wait complete. 2024-04-17T02:23:44.853 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.847+0000 7fcb99acc640 1 Processor -- start 2024-04-17T02:23:44.853 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.847+0000 7fcb99acc640 1 -- start start 2024-04-17T02:23:44.853 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.848+0000 7fcb99acc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb9406b450 0x7fcb941419f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:44.853 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.848+0000 7fcb99acc640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcb940a8ce0 0x7fcb940af240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:44.853 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.848+0000 7fcb99acc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb940ac7c0 0x7fcb941ced60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:44.854 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.848+0000 7fcb99acc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcb94144c90 con 0x7fcb940ac7c0 2024-04-17T02:23:44.854 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.848+0000 7fcb99acc640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcb940a9890 con 0x7fcb9406b450 2024-04-17T02:23:44.854 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.848+0000 7fcb99acc640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fcb94144e10 con 0x7fcb940a8ce0 2024-04-17T02:23:44.854 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.848+0000 7fcb93fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb940ac7c0 0x7fcb941ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:44.854 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.848+0000 7fcb92ffd640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcb940a8ce0 0x7fcb940af240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:44.854 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.848+0000 7fcb93fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb940ac7c0 0x7fcb941ced60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58556/0 (socket says 172.21.15.17:58556) 2024-04-17T02:23:44.854 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.848+0000 7fcb93fff640 1 -- 172.21.15.17:0/1133322131 learned_addr learned my addr 172.21.15.17:0/1133322131 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:23:44.855 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.848+0000 7fcb937fe640 1 --2- 172.21.15.17:0/1133322131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb9406b450 0x7fcb941419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:44.855 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.848+0000 7fcb93fff640 1 -- 172.21.15.17:0/1133322131 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcb940a8ce0 msgr2=0x7fcb940af240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:44.855 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.848+0000 7fcb93fff640 1 --2- 172.21.15.17:0/1133322131 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcb940a8ce0 0x7fcb940af240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:44.855 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.848+0000 7fcb93fff640 1 -- 172.21.15.17:0/1133322131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb9406b450 msgr2=0x7fcb941419f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:44.855 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.848+0000 7fcb93fff640 1 --2- 172.21.15.17:0/1133322131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb9406b450 0x7fcb941419f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:44.855 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.848+0000 7fcb93fff640 1 -- 172.21.15.17:0/1133322131 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb941ce650 con 0x7fcb940ac7c0 2024-04-17T02:23:44.855 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.848+0000 7fcb93fff640 1 --2- 172.21.15.17:0/1133322131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb940ac7c0 0x7fcb941ced60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c009e60 tx=0x7fcb8c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:44.855 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.848+0000 7fcb7bfff640 1 -- 172.21.15.17:0/1133322131 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c018030 con 0x7fcb940ac7c0 2024-04-17T02:23:44.855 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.848+0000 7fcb7bfff640 1 -- 172.21.15.17:0/1133322131 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb8c00cdf0 con 0x7fcb940ac7c0 2024-04-17T02:23:44.855 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.848+0000 7fcb99acc640 1 -- 172.21.15.17:0/1133322131 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb941ce910 con 0x7fcb940ac7c0 2024-04-17T02:23:44.855 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.848+0000 7fcb7bfff640 1 -- 172.21.15.17:0/1133322131 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c003bb0 con 0x7fcb940ac7c0 2024-04-17T02:23:44.856 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.848+0000 7fcb99acc640 1 -- 172.21.15.17:0/1133322131 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb940af780 con 0x7fcb940ac7c0 2024-04-17T02:23:44.856 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.849+0000 7fcb99acc640 1 -- 172.21.15.17:0/1133322131 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb940af9b0 con 0x7fcb940ac7c0 2024-04-17T02:23:44.856 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.851+0000 7fcb7bfff640 1 -- 172.21.15.17:0/1133322131 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 12) ==== 135019+0+0 (secure 0 0 0) 0x7fcb8c005d10 con 0x7fcb940ac7c0 2024-04-17T02:23:44.856 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.851+0000 7fcb7bfff640 20 mgrc handle_mgr_map mgrmap(e 12) 2024-04-17T02:23:44.856 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.851+0000 7fcb7bfff640 4 mgrc handle_mgr_map Got map version 12 2024-04-17T02:23:44.856 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.851+0000 7fcb7bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] 2024-04-17T02:23:44.856 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.851+0000 7fcb7bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] 2024-04-17T02:23:44.856 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.851+0000 7fcb7bfff640 1 --2- 172.21.15.17:0/1133322131 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7fcb8009f5a0 0x7fcb800a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:44.856 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.851+0000 7fcb937fe640 1 -- 172.21.15.17:0/1133322131 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7fcb8009f5a0 msgr2=0x7fcb800a1a60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6808/2667788284 2024-04-17T02:23:44.856 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.852+0000 7fcb7bfff640 1 -- 172.21.15.17:0/1133322131 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4883+0+0 (secure 0 0 0) 0x7fcb8c0ca270 con 0x7fcb940ac7c0 2024-04-17T02:23:44.856 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.852+0000 7fcb937fe640 1 --2- 172.21.15.17:0/1133322131 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7fcb8009f5a0 0x7fcb800a1a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T02:23:44.857 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:44.856+0000 7fcb7bfff640 1 -- 172.21.15.17:0/1133322131 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fcb8c022070 con 0x7fcb940ac7c0 2024-04-17T02:23:45.038 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:45.037+0000 7fcb99acc640 1 -- 172.21.15.17:0/1133322131 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/localpool/failure_domain"} v 0) -- 0x7fcb94068c70 con 0x7fcb940ac7c0 2024-04-17T02:23:45.041 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:45.040+0000 7fcb7bfff640 1 -- 172.21.15.17:0/1133322131 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/localpool/failure_domain"}]=0 v9) ==== 111+0+0 (secure 0 0 0) 0x7fcb8c010040 con 0x7fcb940ac7c0 2024-04-17T02:23:45.054 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:45.053+0000 7fcb937fe640 1 -- 172.21.15.17:0/1133322131 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7fcb8009f5a0 msgr2=0x7fcb800a1a60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6808/2667788284 2024-04-17T02:23:45.054 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:45.053+0000 7fcb937fe640 1 --2- 172.21.15.17:0/1133322131 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7fcb8009f5a0 0x7fcb800a1a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T02:23:45.150 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:45.149+0000 7fcb99acc640 1 -- 172.21.15.17:0/1133322131 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/localpool/failure_domain"} v 0) -- 0x7fcb94141750 con 0x7fcb940ac7c0 2024-04-17T02:23:45.150 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:45.149+0000 7fcb7bfff640 1 -- 172.21.15.17:0/1133322131 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/localpool/failure_domain"}]=0 v9) ==== 111+0+0 (secure 0 0 0) 0x7fcb8c098e80 con 0x7fcb940ac7c0 2024-04-17T02:23:45.153 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:45.151+0000 7fcb99acc640 10 mgrc shutdown 2024-04-17T02:23:45.153 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:45.151+0000 7fcb99acc640 1 -- 172.21.15.17:0/1133322131 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7fcb8009f5a0 msgr2=0x7fcb800a1a60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-17T02:23:45.153 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:45.151+0000 7fcb99acc640 1 --2- 172.21.15.17:0/1133322131 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7fcb8009f5a0 0x7fcb800a1a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:45.153 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:45.151+0000 7fcb99acc640 1 -- 172.21.15.17:0/1133322131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb940ac7c0 msgr2=0x7fcb941ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:45.153 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:45.151+0000 7fcb99acc640 1 --2- 172.21.15.17:0/1133322131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb940ac7c0 0x7fcb941ced60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c009e60 tx=0x7fcb8c00c490 comp rx=0 tx=0).stop 2024-04-17T02:23:45.153 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:45.151+0000 7fcb99acc640 1 -- 172.21.15.17:0/1133322131 shutdown_connections 2024-04-17T02:23:45.153 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:45.151+0000 7fcb99acc640 1 --2- 172.21.15.17:0/1133322131 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7fcb8009f5a0 0x7fcb800a1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:45.153 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:45.151+0000 7fcb99acc640 1 --2- 172.21.15.17:0/1133322131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb940ac7c0 0x7fcb941ced60 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:45.153 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:45.151+0000 7fcb99acc640 1 --2- 172.21.15.17:0/1133322131 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcb940a8ce0 0x7fcb940af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:45.153 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:45.151+0000 7fcb99acc640 1 --2- 172.21.15.17:0/1133322131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb9406b450 0x7fcb941419f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:45.153 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:45.151+0000 7fcb99acc640 1 -- 172.21.15.17:0/1133322131 >> 172.21.15.17:0/1133322131 conn(0x7fcb940a9a70 msgr2=0x7fcb941428c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:23:45.154 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:45.152+0000 7fcb99acc640 1 -- 172.21.15.17:0/1133322131 shutdown_connections 2024-04-17T02:23:45.154 INFO:tasks.workunit.client.0.smithi017.stderr:2024-04-17T02:23:45.152+0000 7fcb99acc640 1 -- 172.21.15.17:0/1133322131 wait complete. 2024-04-17T02:23:45.162 INFO:tasks.workunit.client.0.smithi017.stderr:+ echo OK 2024-04-17T02:23:45.163 INFO:tasks.workunit.client.0.smithi017.stdout:OK 2024-04-17T02:23:45.163 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-17T02:23:45.163 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-17T02:23:45.191 INFO:tasks.workunit:Stopping ['mgr/test_localpool.sh'] on client.0... 2024-04-17T02:23:45.192 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-17T02:23:45.314 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:45.313+0000 7fbaf4841040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-17T02:23:45.317 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:45.316+0000 7fc2dc442040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-17T02:23:45.448 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:45.447+0000 7f2c4bc41040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-17T02:23:45.560 DEBUG:teuthology.parallel:result is None 2024-04-17T02:23:45.560 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-17T02:23:45.581 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:45.580+0000 7fbaf4841040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-17T02:23:45.586 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:45.585+0000 7fc2dc442040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-17T02:23:45.588 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-17T02:23:45.588 DEBUG:teuthology.orchestra.run.smithi017:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-04-17T02:23:45.632 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:45.631+0000 7fbaf4841040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-17T02:23:45.637 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:45.636+0000 7fc2dc442040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-17T02:23:45.730 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:45.729+0000 7f2c4bc41040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-17T02:23:45.739 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-04-17T02:23:45.739 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-17T02:23:45.749 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-17T02:23:45.749 INFO:tasks.ceph.mgr.z.smithi122.stderr:2024-04-17T02:23:45.747+0000 7fbaf4841040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-17T02:23:45.755 INFO:tasks.ceph.mgr.y.smithi122.stderr:2024-04-17T02:23:45.754+0000 7fc2dc442040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-17T02:23:45.783 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:45.782+0000 7f2c4bc41040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-17T02:23:45.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.852+0000 7fe88187b640 1 Processor -- start 2024-04-17T02:23:45.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.852+0000 7fe88187b640 1 -- start start 2024-04-17T02:23:45.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.853+0000 7fe88187b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe87c1426c0 0x7fe87c142aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:45.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.853+0000 7fe88187b640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fe87c0a7600 0x7fe87c14d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:45.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.853+0000 7fe88187b640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe87c143740 con 0x7fe87c142fe0 2024-04-17T02:23:45.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.853+0000 7fe88187b640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fe87c0a6160 con 0x7fe87c1426c0 2024-04-17T02:23:45.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.853+0000 7fe88187b640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fe87c0aaf70 con 0x7fe87c0a7600 2024-04-17T02:23:45.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.853+0000 7fe87b7fe640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fe87c0a7600 0x7fe87c14d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:45.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.853+0000 7fe873fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fe87c142fe0 0x7fe87c0a5a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:57798/0 (socket says 172.21.15.17:57798) 2024-04-17T02:23:45.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.853+0000 7fe873fff640 1 -- 172.21.15.17:0/2890363680 learned_addr learned my addr 172.21.15.17:0/2890363680 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:23:45.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.853+0000 7fe87affd640 1 --2- 172.21.15.17:0/2890363680 >> v2:172.21.15.122:3300/0 conn(0x7fe87c1426c0 0x7fe87c142aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:45.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.854+0000 7fe87a7fc640 1 -- 172.21.15.17:0/2890363680 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 686088143 0 0) 0x7fe87c143740 con 0x7fe87c142fe0 2024-04-17T02:23:45.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.854+0000 7fe87b7fe640 1 -- 172.21.15.17:0/2890363680 >> v2:172.21.15.122:3300/0 conn(0x7fe87c1426c0 msgr2=0x7fe87c142aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:23:45.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.854+0000 7fe87b7fe640 1 --2- 172.21.15.17:0/2890363680 >> v2:172.21.15.122:3300/0 conn(0x7fe87c1426c0 0x7fe87c142aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:45.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.854+0000 7fe87b7fe640 1 -- 172.21.15.17:0/2890363680 >> v1:172.21.15.17:6789/0 conn(0x7fe87c142fe0 legacy=0x7fe87c0a5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:45.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.854+0000 7fe87b7fe640 1 -- 172.21.15.17:0/2890363680 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe87c0a8340 con 0x7fe87c0a7600 2024-04-17T02:23:45.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.855+0000 7fe87b7fe640 1 --2- 172.21.15.17:0/2890363680 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fe87c0a7600 0x7fe87c14d570 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe874009d90 tx=0x7fe87402be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b948e53ddc66dd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:45.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.855+0000 7fe87a7fc640 1 -- 172.21.15.17:0/2890363680 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe874039070 con 0x7fe87c0a7600 2024-04-17T02:23:45.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.855+0000 7fe87a7fc640 1 -- 172.21.15.17:0/2890363680 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe87402cbc0 con 0x7fe87c0a7600 2024-04-17T02:23:45.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.855+0000 7fe87a7fc640 1 -- 172.21.15.17:0/2890363680 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe874034440 con 0x7fe87c0a7600 2024-04-17T02:23:45.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.856+0000 7fe88187b640 1 -- 172.21.15.17:0/2890363680 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fe87c0a7600 msgr2=0x7fe87c14d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:45.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.856+0000 7fe88187b640 1 --2- 172.21.15.17:0/2890363680 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fe87c0a7600 0x7fe87c14d570 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe874009d90 tx=0x7fe87402be10 comp rx=0 tx=0).stop 2024-04-17T02:23:45.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.856+0000 7fe88187b640 1 -- 172.21.15.17:0/2890363680 shutdown_connections 2024-04-17T02:23:45.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.856+0000 7fe88187b640 1 --2- 172.21.15.17:0/2890363680 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fe87c0a7600 0x7fe87c14d570 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:45.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.856+0000 7fe88187b640 1 --2- 172.21.15.17:0/2890363680 >> v2:172.21.15.122:3300/0 conn(0x7fe87c1426c0 0x7fe87c142aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:45.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.856+0000 7fe88187b640 1 -- 172.21.15.17:0/2890363680 >> 172.21.15.17:0/2890363680 conn(0x7fe87c0741a0 msgr2=0x7fe87c0745b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:23:45.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.856+0000 7fe88187b640 1 -- 172.21.15.17:0/2890363680 shutdown_connections 2024-04-17T02:23:45.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.856+0000 7fe88187b640 1 -- 172.21.15.17:0/2890363680 wait complete. 2024-04-17T02:23:45.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.857+0000 7fe88187b640 1 Processor -- start 2024-04-17T02:23:45.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.857+0000 7fe88187b640 1 -- start start 2024-04-17T02:23:45.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.857+0000 7fe88187b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe87c0a7600 0x7fe87c13fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:45.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.857+0000 7fe88187b640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fe87c1426c0 0x7fe87c0a32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:45.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.857+0000 7fe88187b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe87c142fe0 0x7fe87c1ddfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:45.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.857+0000 7fe88187b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe87c14dab0 con 0x7fe87c0a7600 2024-04-17T02:23:45.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.857+0000 7fe88187b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe87c0a7090 con 0x7fe87c142fe0 2024-04-17T02:23:45.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.857+0000 7fe88187b640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fe87c14dc30 con 0x7fe87c1426c0 2024-04-17T02:23:45.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.858+0000 7fe87affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe87c0a7600 0x7fe87c13fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:45.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.858+0000 7fe873fff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fe87c1426c0 0x7fe87c0a32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:45.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.858+0000 7fe87affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe87c0a7600 0x7fe87c13fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58568/0 (socket says 172.21.15.17:58568) 2024-04-17T02:23:45.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.858+0000 7fe87affd640 1 -- 172.21.15.17:0/1972598057 learned_addr learned my addr 172.21.15.17:0/1972598057 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:23:45.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.858+0000 7fe87b7fe640 1 --2- 172.21.15.17:0/1972598057 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe87c142fe0 0x7fe87c1ddfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:45.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.858+0000 7fe873fff640 1 -- 172.21.15.17:0/1972598057 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe87c142fe0 msgr2=0x7fe87c1ddfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:45.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.858+0000 7fe873fff640 1 --2- 172.21.15.17:0/1972598057 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe87c142fe0 0x7fe87c1ddfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:45.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.858+0000 7fe873fff640 1 -- 172.21.15.17:0/1972598057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe87c0a7600 msgr2=0x7fe87c13fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:45.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.858+0000 7fe873fff640 1 --2- 172.21.15.17:0/1972598057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe87c0a7600 0x7fe87c13fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:45.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.858+0000 7fe873fff640 1 -- 172.21.15.17:0/1972598057 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe87c0a4990 con 0x7fe87c1426c0 2024-04-17T02:23:45.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.858+0000 7fe87affd640 1 --2- 172.21.15.17:0/1972598057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe87c0a7600 0x7fe87c13fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:23:45.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.858+0000 7fe873fff640 1 --2- 172.21.15.17:0/1972598057 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fe87c1426c0 0x7fe87c0a32a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe86400c410 tx=0x7fe86400c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:45.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.858+0000 7fe878ff9640 1 -- 172.21.15.17:0/1972598057 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8640074e0 con 0x7fe87c1426c0 2024-04-17T02:23:45.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.858+0000 7fe878ff9640 1 -- 172.21.15.17:0/1972598057 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8640047e0 con 0x7fe87c1426c0 2024-04-17T02:23:45.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.858+0000 7fe878ff9640 1 -- 172.21.15.17:0/1972598057 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe864004bd0 con 0x7fe87c1426c0 2024-04-17T02:23:45.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.858+0000 7fe88187b640 1 -- 172.21.15.17:0/1972598057 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe87c0a4110 con 0x7fe87c1426c0 2024-04-17T02:23:45.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.858+0000 7fe88187b640 1 -- 172.21.15.17:0/1972598057 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe87c0a23d0 con 0x7fe87c1426c0 2024-04-17T02:23:45.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.859+0000 7fe88187b640 1 -- 172.21.15.17:0/1972598057 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe87c067f80 con 0x7fe87c1426c0 2024-04-17T02:23:45.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.860+0000 7fe878ff9640 1 -- 172.21.15.17:0/1972598057 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 12) ==== 135019+0+0 (secure 0 0 0) 0x7fe864011070 con 0x7fe87c1426c0 2024-04-17T02:23:45.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.860+0000 7fe878ff9640 20 mgrc handle_mgr_map mgrmap(e 12) 2024-04-17T02:23:45.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.861+0000 7fe878ff9640 4 mgrc handle_mgr_map Got map version 12 2024-04-17T02:23:45.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.861+0000 7fe878ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] 2024-04-17T02:23:45.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.861+0000 7fe878ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] 2024-04-17T02:23:45.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.861+0000 7fe878ff9640 1 --2- 172.21.15.17:0/1972598057 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7fe85c09f5a0 0x7fe85c0a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:45.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.861+0000 7fe87affd640 1 -- 172.21.15.17:0/1972598057 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7fe85c09f5a0 msgr2=0x7fe85c0a1a60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6808/2667788284 2024-04-17T02:23:45.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.861+0000 7fe878ff9640 1 -- 172.21.15.17:0/1972598057 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 4883+0+0 (secure 0 0 0) 0x7fe8640c92b0 con 0x7fe87c1426c0 2024-04-17T02:23:45.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.861+0000 7fe87affd640 1 --2- 172.21.15.17:0/1972598057 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7fe85c09f5a0 0x7fe85c0a1a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T02:23:45.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.865+0000 7fe878ff9640 1 -- 172.21.15.17:0/1972598057 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe864097fd0 con 0x7fe87c1426c0 2024-04-17T02:23:45.907 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:45.906+0000 7f2c4bc41040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-17T02:23:45.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.917+0000 7fe878ff9640 1 -- 172.21.15.17:0/1972598057 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mgrmap(e 13) ==== 134628+0+0 (secure 0 0 0) 0x7fe8640c7b00 con 0x7fe87c1426c0 2024-04-17T02:23:45.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.917+0000 7fe878ff9640 20 mgrc handle_mgr_map mgrmap(e 13) 2024-04-17T02:23:45.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.917+0000 7fe878ff9640 4 mgrc handle_mgr_map Got map version 13 2024-04-17T02:23:45.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.917+0000 7fe878ff9640 4 mgrc handle_mgr_map Active mgr is now 2024-04-17T02:23:45.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.917+0000 7fe878ff9640 4 mgrc reconnect Terminating session with v2:172.21.15.17:6808/2667788284 2024-04-17T02:23:45.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.917+0000 7fe878ff9640 1 -- 172.21.15.17:0/1972598057 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7fe85c09f5a0 msgr2=0x7fe85c0a1a60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-17T02:23:45.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.917+0000 7fe878ff9640 1 --2- 172.21.15.17:0/1972598057 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7fe85c09f5a0 0x7fe85c0a1a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:45.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:45.917+0000 7fe878ff9640 4 mgrc reconnect No active mgr available yet 2024-04-17T02:23:45.972 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:45.971+0000 7f2bd08c9640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-17T02:23:45.973 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:45.971+0000 7f2bd08c9640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-17T02:23:45.973 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:45.971+0000 7f2bd08c9640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-17T02:23:45.973 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:45.971+0000 7f2bd08c9640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-17T02:23:45.973 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:45.971+0000 7f2bd08c9640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-17T02:23:45.973 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:45.971+0000 7f2bcd0c2640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-17T02:23:45.973 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:45.971+0000 7f2bcd0c2640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-17T02:23:45.973 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:45.971+0000 7f2bcd0c2640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-17T02:23:45.973 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:45.971+0000 7f2bcd0c2640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-17T02:23:45.973 INFO:tasks.ceph.mgr.x.smithi017.stderr:2024-04-17T02:23:45.971+0000 7f2bcd0c2640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-17T02:23:46.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.061+0000 7fe88187b640 1 -- 172.21.15.17:0/1972598057 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fe87c141ee0 con 0x7fe87c1426c0 2024-04-17T02:23:46.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.067+0000 7fe878ff9640 1 -- 172.21.15.17:0/1972598057 <== mon.2 v2:172.21.15.17:3301/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe86404e780 con 0x7fe87c1426c0 2024-04-17T02:23:46.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.067+0000 7fe878ff9640 1 -- 172.21.15.17:0/1972598057 <== mon.2 v2:172.21.15.17:3301/0 9 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7fe86404f090 con 0x7fe87c1426c0 2024-04-17T02:23:46.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.069+0000 7fe88187b640 10 mgrc shutdown 2024-04-17T02:23:46.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.069+0000 7fe88187b640 1 -- 172.21.15.17:0/1972598057 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fe87c1426c0 msgr2=0x7fe87c0a32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:46.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.069+0000 7fe88187b640 1 --2- 172.21.15.17:0/1972598057 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fe87c1426c0 0x7fe87c0a32a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe86400c410 tx=0x7fe86400c8d0 comp rx=0 tx=0).stop 2024-04-17T02:23:46.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.069+0000 7fe88187b640 1 -- 172.21.15.17:0/1972598057 shutdown_connections 2024-04-17T02:23:46.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.069+0000 7fe88187b640 1 --2- 172.21.15.17:0/1972598057 >> [v2:172.21.15.17:6808/2667788284,v1:172.21.15.17:6809/2667788284] conn(0x7fe85c09f5a0 0x7fe85c0a1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:46.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.069+0000 7fe88187b640 1 --2- 172.21.15.17:0/1972598057 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe87c142fe0 0x7fe87c1ddfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:46.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.069+0000 7fe88187b640 1 --2- 172.21.15.17:0/1972598057 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fe87c1426c0 0x7fe87c0a32a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:46.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.069+0000 7fe88187b640 1 --2- 172.21.15.17:0/1972598057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe87c0a7600 0x7fe87c13fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:46.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.069+0000 7fe88187b640 1 -- 172.21.15.17:0/1972598057 >> 172.21.15.17:0/1972598057 conn(0x7fe87c0741a0 msgr2=0x7fe87c0aa230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:23:46.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.069+0000 7fe88187b640 1 -- 172.21.15.17:0/1972598057 shutdown_connections 2024-04-17T02:23:46.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.069+0000 7fe88187b640 1 -- 172.21.15.17:0/1972598057 wait complete. 2024-04-17T02:23:46.082 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-17T02:23:46.083 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T02:23:46.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.227+0000 7fcc9ed67640 1 Processor -- start 2024-04-17T02:23:46.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.227+0000 7fcc9ed67640 1 -- start start 2024-04-17T02:23:46.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.228+0000 7fcc9ed67640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcc9806f5e0 0x7fcc980a9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:46.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.228+0000 7fcc9ed67640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fcc98145060 0x7fcc98145850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:46.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.228+0000 7fcc9ed67640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc980a7960 con 0x7fcc980b8ed0 2024-04-17T02:23:46.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.228+0000 7fcc9ed67640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fcc980b92b0 con 0x7fcc98145060 2024-04-17T02:23:46.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.228+0000 7fcc9ed67640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fcc98145590 con 0x7fcc9806f5e0 2024-04-17T02:23:46.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.228+0000 7fcc8ffff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcc9806f5e0 0x7fcc980a9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:46.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.228+0000 7fcc8ffff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcc9806f5e0 0x7fcc980a9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:38120/0 (socket says 172.21.15.17:38120) 2024-04-17T02:23:46.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.228+0000 7fcc8ffff640 1 -- 172.21.15.17:0/861988818 learned_addr learned my addr 172.21.15.17:0/861988818 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:23:46.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.228+0000 7fcc9d304640 1 --2- 172.21.15.17:0/861988818 >> v2:172.21.15.122:3300/0 conn(0x7fcc98145060 0x7fcc98145850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:46.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.228+0000 7fcc8ffff640 1 -- 172.21.15.17:0/861988818 >> v2:172.21.15.122:3300/0 conn(0x7fcc98145060 msgr2=0x7fcc98145850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:23:46.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.228+0000 7fcc8ffff640 1 --2- 172.21.15.17:0/861988818 >> v2:172.21.15.122:3300/0 conn(0x7fcc98145060 0x7fcc98145850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:46.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.228+0000 7fcc8ffff640 1 -- 172.21.15.17:0/861988818 >> v1:172.21.15.122:6789/0 conn(0x7fcc980b8ed0 legacy=0x7fcc980aaa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:46.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.228+0000 7fcc8ffff640 1 -- 172.21.15.17:0/861988818 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc980aa500 con 0x7fcc9806f5e0 2024-04-17T02:23:46.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.229+0000 7fcc8ffff640 1 --2- 172.21.15.17:0/861988818 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcc9806f5e0 0x7fcc980a9fc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcc88009850 tx=0x7fcc8802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dddff647bdd034f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:46.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.229+0000 7fcc8f7fe640 1 -- 172.21.15.17:0/861988818 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc88037070 con 0x7fcc9806f5e0 2024-04-17T02:23:46.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.229+0000 7fcc8f7fe640 1 -- 172.21.15.17:0/861988818 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fcc88004030 con 0x7fcc9806f5e0 2024-04-17T02:23:46.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.229+0000 7fcc8f7fe640 1 -- 172.21.15.17:0/861988818 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc88004480 con 0x7fcc9806f5e0 2024-04-17T02:23:46.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.229+0000 7fcc9ed67640 1 -- 172.21.15.17:0/861988818 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcc9806f5e0 msgr2=0x7fcc980a9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:46.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.229+0000 7fcc9ed67640 1 --2- 172.21.15.17:0/861988818 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcc9806f5e0 0x7fcc980a9fc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcc88009850 tx=0x7fcc8802b840 comp rx=0 tx=0).stop 2024-04-17T02:23:46.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.230+0000 7fcc9ed67640 1 -- 172.21.15.17:0/861988818 shutdown_connections 2024-04-17T02:23:46.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.230+0000 7fcc9ed67640 1 --2- 172.21.15.17:0/861988818 >> v2:172.21.15.122:3300/0 conn(0x7fcc98145060 0x7fcc98145850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:46.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.230+0000 7fcc9ed67640 1 --2- 172.21.15.17:0/861988818 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcc9806f5e0 0x7fcc980a9fc0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:46.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.230+0000 7fcc9ed67640 1 -- 172.21.15.17:0/861988818 >> 172.21.15.17:0/861988818 conn(0x7fcc980741a0 msgr2=0x7fcc980745b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:23:46.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.230+0000 7fcc9ed67640 1 -- 172.21.15.17:0/861988818 shutdown_connections 2024-04-17T02:23:46.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.230+0000 7fcc9ed67640 1 -- 172.21.15.17:0/861988818 wait complete. 2024-04-17T02:23:46.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.231+0000 7fcc9ed67640 1 Processor -- start 2024-04-17T02:23:46.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.231+0000 7fcc9ed67640 1 -- start start 2024-04-17T02:23:46.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.231+0000 7fcc9ed67640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc9806f5e0 0x7fcc981356b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:46.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.231+0000 7fcc9ed67640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc980b8ed0 0x7fcc9813ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:46.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.231+0000 7fcc9ed67640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcc98145060 0x7fcc9806d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:46.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.231+0000 7fcc9ed67640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcc9814fa60 con 0x7fcc9806f5e0 2024-04-17T02:23:46.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.231+0000 7fcc9ed67640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcc98145fa0 con 0x7fcc980b8ed0 2024-04-17T02:23:46.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.231+0000 7fcc9ed67640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fcc9814fbe0 con 0x7fcc98145060 2024-04-17T02:23:46.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.231+0000 7fcc9d304640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcc98145060 0x7fcc9806d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:46.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.231+0000 7fcc9cb03640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc9806f5e0 0x7fcc981356b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:46.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.231+0000 7fcc9d304640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcc98145060 0x7fcc9806d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:38124/0 (socket says 172.21.15.17:38124) 2024-04-17T02:23:46.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.231+0000 7fcc9cb03640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc9806f5e0 0x7fcc981356b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58674/0 (socket says 172.21.15.17:58674) 2024-04-17T02:23:46.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.231+0000 7fcc9d304640 1 -- 172.21.15.17:0/2093649137 learned_addr learned my addr 172.21.15.17:0/2093649137 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:23:46.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.232+0000 7fcc8ffff640 1 --2- 172.21.15.17:0/2093649137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc980b8ed0 0x7fcc9813ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:46.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.232+0000 7fcc9d304640 1 -- 172.21.15.17:0/2093649137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc980b8ed0 msgr2=0x7fcc9813ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:46.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.232+0000 7fcc9d304640 1 --2- 172.21.15.17:0/2093649137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc980b8ed0 0x7fcc9813ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:46.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.232+0000 7fcc9d304640 1 -- 172.21.15.17:0/2093649137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc9806f5e0 msgr2=0x7fcc981356b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:46.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.232+0000 7fcc9d304640 1 --2- 172.21.15.17:0/2093649137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc9806f5e0 0x7fcc981356b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:46.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.232+0000 7fcc9d304640 1 -- 172.21.15.17:0/2093649137 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc9806eb30 con 0x7fcc98145060 2024-04-17T02:23:46.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.232+0000 7fcc9cb03640 1 --2- 172.21.15.17:0/2093649137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc9806f5e0 0x7fcc981356b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:23:46.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.232+0000 7fcc9d304640 1 --2- 172.21.15.17:0/2093649137 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcc98145060 0x7fcc9806d9a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcc9000efc0 tx=0x7fcc9000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:46.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.232+0000 7fcc8d7fa640 1 -- 172.21.15.17:0/2093649137 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc90018020 con 0x7fcc98145060 2024-04-17T02:23:46.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.232+0000 7fcc8d7fa640 1 -- 172.21.15.17:0/2093649137 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fcc90014480 con 0x7fcc98145060 2024-04-17T02:23:46.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.232+0000 7fcc8d7fa640 1 -- 172.21.15.17:0/2093649137 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc90014890 con 0x7fcc98145060 2024-04-17T02:23:46.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.232+0000 7fcc9ed67640 1 -- 172.21.15.17:0/2093649137 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc9806c770 con 0x7fcc98145060 2024-04-17T02:23:46.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.232+0000 7fcc9ed67640 1 -- 172.21.15.17:0/2093649137 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc9813ba40 con 0x7fcc98145060 2024-04-17T02:23:46.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.233+0000 7fcc9ed67640 1 -- 172.21.15.17:0/2093649137 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc980687f0 con 0x7fcc98145060 2024-04-17T02:23:46.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.234+0000 7fcc8d7fa640 1 -- 172.21.15.17:0/2093649137 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 13) ==== 134628+0+0 (secure 0 0 0) 0x7fcc90005d10 con 0x7fcc98145060 2024-04-17T02:23:46.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.234+0000 7fcc8d7fa640 20 mgrc handle_mgr_map mgrmap(e 13) 2024-04-17T02:23:46.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.235+0000 7fcc8d7fa640 4 mgrc handle_mgr_map Got map version 13 2024-04-17T02:23:46.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.235+0000 7fcc8d7fa640 4 mgrc handle_mgr_map Active mgr is now 2024-04-17T02:23:46.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.235+0000 7fcc8d7fa640 4 mgrc reconnect No active mgr available yet 2024-04-17T02:23:46.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.235+0000 7fcc8d7fa640 1 -- 172.21.15.17:0/2093649137 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 5227+0+0 (secure 0 0 0) 0x7fcc900ca070 con 0x7fcc98145060 2024-04-17T02:23:46.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.239+0000 7fcc8d7fa640 1 -- 172.21.15.17:0/2093649137 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fcc90022030 con 0x7fcc98145060 2024-04-17T02:23:46.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.458+0000 7fcc9ed67640 1 -- 172.21.15.17:0/2093649137 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc980a5ff0 con 0x7fcc98145060 2024-04-17T02:23:46.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.458+0000 7fcc8d7fa640 1 -- 172.21.15.17:0/2093649137 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4348 (secure 0 0 0) 0x7fcc90010040 con 0x7fcc98145060 2024-04-17T02:23:46.460 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:23:46.460 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4228,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6813/1946927344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6811","nonce":1946927344},{"type":"v1","addr":"172.21.15.17:6813","nonce":1946927344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4234,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6825/529920036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":529920036},{"type":"v1","addr":"172.21.15.122:6825","nonce":529920036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T02:22:21.611698+0000","modified":"2024-04-17T02:22:23.609137+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6812/356803728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":356803728},{"type":"v1","addr":"172.21.15.17:6812","nonce":356803728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4254,"qdb_cluster":[4254]},"id":1}]} 2024-04-17T02:23:46.460 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 6 2024-04-17T02:23:46.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.460+0000 7fcc9ed67640 10 mgrc shutdown 2024-04-17T02:23:46.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.460+0000 7fcc9ed67640 1 -- 172.21.15.17:0/2093649137 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcc98145060 msgr2=0x7fcc9806d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:46.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.460+0000 7fcc9ed67640 1 --2- 172.21.15.17:0/2093649137 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcc98145060 0x7fcc9806d9a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcc9000efc0 tx=0x7fcc9000c490 comp rx=0 tx=0).stop 2024-04-17T02:23:46.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.460+0000 7fcc9ed67640 1 -- 172.21.15.17:0/2093649137 shutdown_connections 2024-04-17T02:23:46.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.460+0000 7fcc9ed67640 1 --2- 172.21.15.17:0/2093649137 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fcc98145060 0x7fcc9806d9a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:46.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.460+0000 7fcc9ed67640 1 --2- 172.21.15.17:0/2093649137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc980b8ed0 0x7fcc9813ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:46.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.460+0000 7fcc9ed67640 1 --2- 172.21.15.17:0/2093649137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc9806f5e0 0x7fcc981356b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:46.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.460+0000 7fcc9ed67640 1 -- 172.21.15.17:0/2093649137 >> 172.21.15.17:0/2093649137 conn(0x7fcc980741a0 msgr2=0x7fcc98071ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:23:46.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.461+0000 7fcc9ed67640 1 -- 172.21.15.17:0/2093649137 shutdown_connections 2024-04-17T02:23:46.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.461+0000 7fcc9ed67640 1 -- 172.21.15.17:0/2093649137 wait complete. 2024-04-17T02:23:46.473 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T02:23:46.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.577+0000 7fa73d5a8640 1 Processor -- start 2024-04-17T02:23:46.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.577+0000 7fa73d5a8640 1 -- start start 2024-04-17T02:23:46.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.578+0000 7fa73d5a8640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fa7380a9560 0x7fa738145730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:46.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.578+0000 7fa73d5a8640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa738145c70 0x7fa73814f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:46.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.578+0000 7fa73d5a8640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7380a7f00 con 0x7fa7380ab3b0 2024-04-17T02:23:46.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.578+0000 7fa73d5a8640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fa7380abd20 con 0x7fa738145c70 2024-04-17T02:23:46.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.578+0000 7fa73d5a8640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fa7380ac000 con 0x7fa7380a9560 2024-04-17T02:23:46.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.578+0000 7fa736ffd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fa7380ab3b0 0x7fa7380ac7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:57808/0 (socket says 172.21.15.17:57808) 2024-04-17T02:23:46.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.578+0000 7fa72e7fc640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fa7380a9560 0x7fa738145730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:46.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.578+0000 7fa736ffd640 1 -- 172.21.15.17:0/171537765 learned_addr learned my addr 172.21.15.17:0/171537765 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:23:46.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.578+0000 7fa7367fc640 1 -- 172.21.15.17:0/171537765 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 168548353 0 0) 0x7fa7380a7f00 con 0x7fa7380ab3b0 2024-04-17T02:23:46.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.578+0000 7fa72e7fc640 1 -- 172.21.15.17:0/171537765 >> v2:172.21.15.122:3300/0 conn(0x7fa738145c70 msgr2=0x7fa73814f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:23:46.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.578+0000 7fa7377fe640 1 --2- 172.21.15.17:0/171537765 >> v2:172.21.15.122:3300/0 conn(0x7fa738145c70 0x7fa73814f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:46.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.578+0000 7fa72e7fc640 1 --2- 172.21.15.17:0/171537765 >> v2:172.21.15.122:3300/0 conn(0x7fa738145c70 0x7fa73814f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:46.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.578+0000 7fa72e7fc640 1 -- 172.21.15.17:0/171537765 >> v1:172.21.15.17:6789/0 conn(0x7fa7380ab3b0 legacy=0x7fa7380ac7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:46.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.578+0000 7fa72e7fc640 1 -- 172.21.15.17:0/171537765 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7380a7960 con 0x7fa7380a9560 2024-04-17T02:23:46.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.579+0000 7fa72e7fc640 1 --2- 172.21.15.17:0/171537765 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fa7380a9560 0x7fa738145730 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa7380a7b90 tx=0x7fa72002b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdbf919400e23451 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:46.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.579+0000 7fa7367fc640 1 -- 172.21.15.17:0/171537765 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa720031770 con 0x7fa7380a9560 2024-04-17T02:23:46.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.579+0000 7fa7367fc640 1 -- 172.21.15.17:0/171537765 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa720037070 con 0x7fa7380a9560 2024-04-17T02:23:46.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.579+0000 7fa7367fc640 1 -- 172.21.15.17:0/171537765 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa720031b50 con 0x7fa7380a9560 2024-04-17T02:23:46.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.579+0000 7fa73d5a8640 1 -- 172.21.15.17:0/171537765 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fa7380a9560 msgr2=0x7fa738145730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:46.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.579+0000 7fa73d5a8640 1 --2- 172.21.15.17:0/171537765 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fa7380a9560 0x7fa738145730 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa7380a7b90 tx=0x7fa72002b810 comp rx=0 tx=0).stop 2024-04-17T02:23:46.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.579+0000 7fa73d5a8640 1 -- 172.21.15.17:0/171537765 shutdown_connections 2024-04-17T02:23:46.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.579+0000 7fa73d5a8640 1 --2- 172.21.15.17:0/171537765 >> v2:172.21.15.122:3300/0 conn(0x7fa738145c70 0x7fa73814f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:46.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.579+0000 7fa73d5a8640 1 --2- 172.21.15.17:0/171537765 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fa7380a9560 0x7fa738145730 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:46.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.579+0000 7fa73d5a8640 1 -- 172.21.15.17:0/171537765 >> 172.21.15.17:0/171537765 conn(0x7fa7380a9b60 msgr2=0x7fa7380a9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:23:46.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.580+0000 7fa73d5a8640 1 -- 172.21.15.17:0/171537765 shutdown_connections 2024-04-17T02:23:46.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.580+0000 7fa73d5a8640 1 -- 172.21.15.17:0/171537765 wait complete. 2024-04-17T02:23:46.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.580+0000 7fa73d5a8640 1 Processor -- start 2024-04-17T02:23:46.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.581+0000 7fa73d5a8640 1 -- start start 2024-04-17T02:23:46.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.581+0000 7fa73d5a8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7380a9560 0x7fa73814a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:46.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.581+0000 7fa73d5a8640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fa7380ab3b0 0x7fa738143140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:46.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.581+0000 7fa73d5a8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa738145c70 0x7fa7381483f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:46.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.581+0000 7fa73d5a8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa73806b5b0 con 0x7fa738145c70 2024-04-17T02:23:46.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.581+0000 7fa73d5a8640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa7380ab790 con 0x7fa7380a9560 2024-04-17T02:23:46.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.581+0000 7fa73d5a8640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fa738143fc0 con 0x7fa7380ab3b0 2024-04-17T02:23:46.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.581+0000 7fa72e7fc640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fa7380ab3b0 0x7fa738143140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:46.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.581+0000 7fa7377fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa738145c70 0x7fa7381483f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:46.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.581+0000 7fa72e7fc640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fa7380ab3b0 0x7fa738143140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:38146/0 (socket says 172.21.15.17:38146) 2024-04-17T02:23:46.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.581+0000 7fa72e7fc640 1 -- 172.21.15.17:0/3670340973 learned_addr learned my addr 172.21.15.17:0/3670340973 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:23:46.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.582+0000 7fa736ffd640 1 --2- 172.21.15.17:0/3670340973 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7380a9560 0x7fa73814a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:46.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.582+0000 7fa72e7fc640 1 -- 172.21.15.17:0/3670340973 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7380a9560 msgr2=0x7fa73814a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:46.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.582+0000 7fa72e7fc640 1 --2- 172.21.15.17:0/3670340973 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7380a9560 0x7fa73814a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:46.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.582+0000 7fa72e7fc640 1 -- 172.21.15.17:0/3670340973 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa738145c70 msgr2=0x7fa7381483f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:46.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.582+0000 7fa72e7fc640 1 --2- 172.21.15.17:0/3670340973 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa738145c70 0x7fa7381483f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:46.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.582+0000 7fa72e7fc640 1 -- 172.21.15.17:0/3670340973 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7381386d0 con 0x7fa7380ab3b0 2024-04-17T02:23:46.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.582+0000 7fa736ffd640 1 --2- 172.21.15.17:0/3670340973 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7380a9560 0x7fa73814a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T02:23:46.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.582+0000 7fa72e7fc640 1 --2- 172.21.15.17:0/3670340973 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fa7380ab3b0 0x7fa738143140 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa7200096f0 tx=0x7fa7200046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:46.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.582+0000 7fa72ffff640 1 -- 172.21.15.17:0/3670340973 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa720032810 con 0x7fa7380ab3b0 2024-04-17T02:23:46.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.582+0000 7fa72ffff640 1 -- 172.21.15.17:0/3670340973 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa7200329b0 con 0x7fa7380ab3b0 2024-04-17T02:23:46.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.582+0000 7fa72ffff640 1 -- 172.21.15.17:0/3670340973 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa720032dc0 con 0x7fa7380ab3b0 2024-04-17T02:23:46.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.582+0000 7fa73d5a8640 1 -- 172.21.15.17:0/3670340973 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa738138990 con 0x7fa7380ab3b0 2024-04-17T02:23:46.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.582+0000 7fa73d5a8640 1 -- 172.21.15.17:0/3670340973 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7381495f0 con 0x7fa7380ab3b0 2024-04-17T02:23:46.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.583+0000 7fa73d5a8640 1 -- 172.21.15.17:0/3670340973 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7380b8e50 con 0x7fa7380ab3b0 2024-04-17T02:23:46.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.584+0000 7fa72ffff640 1 -- 172.21.15.17:0/3670340973 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 13) ==== 134628+0+0 (secure 0 0 0) 0x7fa720031070 con 0x7fa7380ab3b0 2024-04-17T02:23:46.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.584+0000 7fa72ffff640 20 mgrc handle_mgr_map mgrmap(e 13) 2024-04-17T02:23:46.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.585+0000 7fa72ffff640 4 mgrc handle_mgr_map Got map version 13 2024-04-17T02:23:46.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.585+0000 7fa72ffff640 4 mgrc handle_mgr_map Active mgr is now 2024-04-17T02:23:46.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.585+0000 7fa72ffff640 4 mgrc reconnect No active mgr available yet 2024-04-17T02:23:46.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.585+0000 7fa72ffff640 1 -- 172.21.15.17:0/3670340973 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 5227+0+0 (secure 0 0 0) 0x7fa7200eb050 con 0x7fa7380ab3b0 2024-04-17T02:23:46.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.589+0000 7fa72ffff640 1 -- 172.21.15.17:0/3670340973 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fa7380b8e50 con 0x7fa7380ab3b0 2024-04-17T02:23:46.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.806+0000 7fa73d5a8640 1 -- 172.21.15.17:0/3670340973 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa7380687f0 con 0x7fa7380ab3b0 2024-04-17T02:23:46.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.807+0000 7fa72ffff640 1 -- 172.21.15.17:0/3670340973 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4348 (secure 0 0 0) 0x7fa720040070 con 0x7fa7380ab3b0 2024-04-17T02:23:46.808 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:23:46.808 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4228,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6813/1946927344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6811","nonce":1946927344},{"type":"v1","addr":"172.21.15.17:6813","nonce":1946927344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4234,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6825/529920036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":529920036},{"type":"v1","addr":"172.21.15.122:6825","nonce":529920036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T02:22:21.611698+0000","modified":"2024-04-17T02:22:23.609137+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6812/356803728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":356803728},{"type":"v1","addr":"172.21.15.17:6812","nonce":356803728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4254,"qdb_cluster":[4254]},"id":1}]} 2024-04-17T02:23:46.808 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 6 2024-04-17T02:23:46.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.809+0000 7fa73d5a8640 10 mgrc shutdown 2024-04-17T02:23:46.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.809+0000 7fa73d5a8640 1 -- 172.21.15.17:0/3670340973 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fa7380ab3b0 msgr2=0x7fa738143140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:46.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.809+0000 7fa73d5a8640 1 --2- 172.21.15.17:0/3670340973 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fa7380ab3b0 0x7fa738143140 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa7200096f0 tx=0x7fa7200046c0 comp rx=0 tx=0).stop 2024-04-17T02:23:46.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.809+0000 7fa73d5a8640 1 -- 172.21.15.17:0/3670340973 shutdown_connections 2024-04-17T02:23:46.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.809+0000 7fa73d5a8640 1 --2- 172.21.15.17:0/3670340973 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa738145c70 0x7fa7381483f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:46.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.809+0000 7fa73d5a8640 1 --2- 172.21.15.17:0/3670340973 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fa7380ab3b0 0x7fa738143140 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:46.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.809+0000 7fa73d5a8640 1 --2- 172.21.15.17:0/3670340973 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7380a9560 0x7fa73814a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:46.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.809+0000 7fa73d5a8640 1 -- 172.21.15.17:0/3670340973 >> 172.21.15.17:0/3670340973 conn(0x7fa7380a9b60 msgr2=0x7fa738068ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:23:46.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.809+0000 7fa73d5a8640 1 -- 172.21.15.17:0/3670340973 shutdown_connections 2024-04-17T02:23:46.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.809+0000 7fa73d5a8640 1 -- 172.21.15.17:0/3670340973 wait complete. 2024-04-17T02:23:46.821 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T02:23:46.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.930+0000 7f94e6183640 1 Processor -- start 2024-04-17T02:23:46.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.930+0000 7f94e6183640 1 -- start start 2024-04-17T02:23:46.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.931+0000 7f94e6183640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f94e0067560 0x7f94e0144870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:46.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.931+0000 7f94e6183640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f94e00a9100 0x7f94e00a8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:46.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.931+0000 7f94e6183640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94e0148890 con 0x7f94e0144db0 2024-04-17T02:23:46.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.931+0000 7f94e6183640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f94e0067940 con 0x7f94e0067560 2024-04-17T02:23:46.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.931+0000 7f94e6183640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f94e0148b30 con 0x7f94e00a9100 2024-04-17T02:23:46.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.931+0000 7f94d7fff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f94e00a9100 0x7f94e00a8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:46.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.931+0000 7f94d7fff640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f94e00a9100 0x7f94e00a8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:38162/0 (socket says 172.21.15.17:38162) 2024-04-17T02:23:46.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.931+0000 7f94d7fff640 1 -- 172.21.15.17:0/2512074513 learned_addr learned my addr 172.21.15.17:0/2512074513 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:23:46.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.931+0000 7f94df7fe640 1 --2- 172.21.15.17:0/2512074513 >> v2:172.21.15.122:3300/0 conn(0x7f94e0067560 0x7f94e0144870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:46.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.931+0000 7f94d7fff640 1 -- 172.21.15.17:0/2512074513 >> v2:172.21.15.122:3300/0 conn(0x7f94e0067560 msgr2=0x7f94e0144870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:23:46.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.931+0000 7f94d7fff640 1 --2- 172.21.15.17:0/2512074513 >> v2:172.21.15.122:3300/0 conn(0x7f94e0067560 0x7f94e0144870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:46.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.931+0000 7f94d7fff640 1 -- 172.21.15.17:0/2512074513 >> v1:172.21.15.122:6789/0 conn(0x7f94e0144db0 legacy=0x7f94e00a4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:46.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.931+0000 7f94d7fff640 1 -- 172.21.15.17:0/2512074513 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94e00a4060 con 0x7f94e00a9100 2024-04-17T02:23:46.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.932+0000 7f94d7fff640 1 --2- 172.21.15.17:0/2512074513 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f94e00a9100 0x7f94e00a8380 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f94c8009870 tx=0x7f94c802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75b24aefc1e43a59 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:46.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.932+0000 7f94deffd640 1 -- 172.21.15.17:0/2512074513 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c8034070 con 0x7f94e00a9100 2024-04-17T02:23:46.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.932+0000 7f94deffd640 1 -- 172.21.15.17:0/2512074513 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f94c8030840 con 0x7f94e00a9100 2024-04-17T02:23:46.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.932+0000 7f94deffd640 1 -- 172.21.15.17:0/2512074513 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c8030c30 con 0x7f94e00a9100 2024-04-17T02:23:46.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.933+0000 7f94e6183640 1 -- 172.21.15.17:0/2512074513 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f94e00a9100 msgr2=0x7f94e00a8380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:46.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.933+0000 7f94e6183640 1 --2- 172.21.15.17:0/2512074513 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f94e00a9100 0x7f94e00a8380 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f94c8009870 tx=0x7f94c802b980 comp rx=0 tx=0).stop 2024-04-17T02:23:46.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.933+0000 7f94e6183640 1 -- 172.21.15.17:0/2512074513 shutdown_connections 2024-04-17T02:23:46.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.933+0000 7f94e6183640 1 --2- 172.21.15.17:0/2512074513 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f94e00a9100 0x7f94e00a8380 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:46.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.933+0000 7f94e6183640 1 --2- 172.21.15.17:0/2512074513 >> v2:172.21.15.122:3300/0 conn(0x7f94e0067560 0x7f94e0144870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:46.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.933+0000 7f94e6183640 1 -- 172.21.15.17:0/2512074513 >> 172.21.15.17:0/2512074513 conn(0x7f94e006b730 msgr2=0x7f94e00a6260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:23:46.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.933+0000 7f94e6183640 1 -- 172.21.15.17:0/2512074513 shutdown_connections 2024-04-17T02:23:46.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.933+0000 7f94e6183640 1 -- 172.21.15.17:0/2512074513 wait complete. 2024-04-17T02:23:46.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.934+0000 7f94e6183640 1 Processor -- start 2024-04-17T02:23:46.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.934+0000 7f94e6183640 1 -- start start 2024-04-17T02:23:46.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.934+0000 7f94e6183640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f94e0067560 0x7f94e00a0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:46.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.934+0000 7f94e6183640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94e00a9100 0x7f94e01da7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:46.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.934+0000 7f94e6183640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94e0144db0 0x7f94e01dad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:46.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.934+0000 7f94e6183640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f94e00a88c0 con 0x7f94e0144db0 2024-04-17T02:23:46.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.934+0000 7f94e6183640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f94e00a05d0 con 0x7f94e00a9100 2024-04-17T02:23:46.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.934+0000 7f94e6183640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f94e00a8a40 con 0x7f94e0067560 2024-04-17T02:23:46.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.934+0000 7f94df7fe640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f94e0067560 0x7f94e00a0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:46.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.934+0000 7f94dffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94e0144db0 0x7f94e01dad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:46.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.934+0000 7f94df7fe640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f94e0067560 0x7f94e00a0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:38168/0 (socket says 172.21.15.17:38168) 2024-04-17T02:23:46.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.934+0000 7f94df7fe640 1 -- 172.21.15.17:0/2159915542 learned_addr learned my addr 172.21.15.17:0/2159915542 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:23:46.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.935+0000 7f94d7fff640 1 --2- 172.21.15.17:0/2159915542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94e00a9100 0x7f94e01da7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:46.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.935+0000 7f94dffff640 1 -- 172.21.15.17:0/2159915542 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f94e0067560 msgr2=0x7f94e00a0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:46.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.935+0000 7f94dffff640 1 --2- 172.21.15.17:0/2159915542 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f94e0067560 0x7f94e00a0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:46.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.935+0000 7f94dffff640 1 -- 172.21.15.17:0/2159915542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94e00a9100 msgr2=0x7f94e01da7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:46.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.935+0000 7f94dffff640 1 --2- 172.21.15.17:0/2159915542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94e00a9100 0x7f94e01da7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:46.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.935+0000 7f94dffff640 1 -- 172.21.15.17:0/2159915542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94e01db430 con 0x7f94e0144db0 2024-04-17T02:23:46.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.935+0000 7f94dffff640 1 --2- 172.21.15.17:0/2159915542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94e0144db0 0x7f94e01dad10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f94e01451e0 tx=0x7f94d800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:46.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.935+0000 7f94dcff9640 1 -- 172.21.15.17:0/2159915542 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d8003b70 con 0x7f94e0144db0 2024-04-17T02:23:46.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.935+0000 7f94dcff9640 1 -- 172.21.15.17:0/2159915542 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f94d8003d10 con 0x7f94e0144db0 2024-04-17T02:23:46.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.935+0000 7f94e6183640 1 -- 172.21.15.17:0/2159915542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94e01db6f0 con 0x7f94e0144db0 2024-04-17T02:23:46.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.935+0000 7f94dcff9640 1 -- 172.21.15.17:0/2159915542 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d8005330 con 0x7f94e0144db0 2024-04-17T02:23:46.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.935+0000 7f94e6183640 1 -- 172.21.15.17:0/2159915542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94e01446a0 con 0x7f94e0144db0 2024-04-17T02:23:46.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.936+0000 7f94e6183640 1 -- 172.21.15.17:0/2159915542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94e00687f0 con 0x7f94e0144db0 2024-04-17T02:23:46.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.938+0000 7f94dcff9640 1 -- 172.21.15.17:0/2159915542 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 14) ==== 134755+0+0 (secure 0 0 0) 0x7f94d80054d0 con 0x7f94e0144db0 2024-04-17T02:23:46.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.938+0000 7f94dcff9640 20 mgrc handle_mgr_map mgrmap(e 14) 2024-04-17T02:23:46.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.939+0000 7f94dcff9640 4 mgrc handle_mgr_map Got map version 14 2024-04-17T02:23:46.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.939+0000 7f94dcff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] 2024-04-17T02:23:46.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.939+0000 7f94dcff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] 2024-04-17T02:23:46.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.939+0000 7f94dcff9640 1 --2- 172.21.15.17:0/2159915542 >> [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] conn(0x7f94c009f300 0x7f94c00a17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:46.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.939+0000 7f94df7fe640 1 --2- 172.21.15.17:0/2159915542 >> [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] conn(0x7f94c009f300 0x7f94c00a17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:46.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.939+0000 7f94dcff9640 1 -- 172.21.15.17:0/2159915542 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5227+0+0 (secure 0 0 0) 0x7f94d80c9c60 con 0x7f94e0144db0 2024-04-17T02:23:46.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.939+0000 7f94df7fe640 1 --2- 172.21.15.17:0/2159915542 >> [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] conn(0x7f94c009f300 0x7f94c00a17c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009c00 tx=0x7f94d0009190 comp rx=0 tx=0).ready entity=mgr.4776 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:46.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:46.942+0000 7f94dcff9640 1 -- 172.21.15.17:0/2159915542 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f94d8098c80 con 0x7f94e0144db0 2024-04-17T02:23:47.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.128+0000 7f94e6183640 1 -- 172.21.15.17:0/2159915542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f94e00732d0 con 0x7f94e0144db0 2024-04-17T02:23:47.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.129+0000 7f94dcff9640 1 -- 172.21.15.17:0/2159915542 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+14677 (secure 0 0 0) 0x7f94d8098580 con 0x7f94e0144db0 2024-04-17T02:23:47.130 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-04-17T02:23:47.130 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":30,"fsid":"7cbfae20-b10d-41da-92b7-cbd5c1632e23","created":"2024-04-17T02:22:00.246446+0000","modified":"2024-04-17T02:23:45.908966+0000","last_up_change":"2024-04-17T02:22:09.077928+0000","last_in_change":"2024-04-17T02:22:01.415384+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T02:22:10.533377+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-17T02:22:15.947495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-17T02:22:20.016616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-17T02:22:20.573938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2973665c-6c5e-4688-bffe-72d3bdcf467f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6801","nonce":1828284343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6803","nonce":1828284343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6807","nonce":1828284343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1828284343},{"type":"v1","addr":"172.21.15.17:6805","nonce":1828284343}]},"public_addr":"172.21.15.17:6801/1828284343","cluster_addr":"172.21.15.17:6803/1828284343","heartbeat_back_addr":"172.21.15.17:6807/1828284343","heartbeat_front_addr":"172.21.15.17:6805/1828284343","state":["exists","up"]},{"osd":1,"uuid":"a59a034d-19b4-47e8-8ca5-538597b4af1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6809","nonce":2064593011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6811","nonce":2064593011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6815","nonce":2064593011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":2064593011},{"type":"v1","addr":"172.21.15.122:6813","nonce":2064593011}]},"public_addr":"172.21.15.122:6809/2064593011","cluster_addr":"172.21.15.122:6811/2064593011","heartbeat_back_addr":"172.21.15.122:6815/2064593011","heartbeat_front_addr":"172.21.15.122:6813/2064593011","state":["exists","up"]},{"osd":2,"uuid":"070f4c5f-459f-46ff-b980-05b1ac50c951","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6817","nonce":929092547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6819","nonce":929092547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6823","nonce":929092547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":929092547},{"type":"v1","addr":"172.21.15.122:6821","nonce":929092547}]},"public_addr":"172.21.15.122:6817/929092547","cluster_addr":"172.21.15.122:6819/929092547","heartbeat_back_addr":"172.21.15.122:6823/929092547","heartbeat_front_addr":"172.21.15.122:6821/929092547","state":["exists","up"]},{"osd":3,"uuid":"96216a49-a7b6-40eb-bc93-cc8c78a5270a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6801","nonce":204132523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6803","nonce":204132523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6807","nonce":204132523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":204132523},{"type":"v1","addr":"172.21.15.122:6805","nonce":204132523}]},"public_addr":"172.21.15.122:6801/204132523","cluster_addr":"172.21.15.122:6803/204132523","heartbeat_back_addr":"172.21.15.122:6807/204132523","heartbeat_front_addr":"172.21.15.122:6805/204132523","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.477173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.522791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.590625+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T02:22:06.480698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.2b","mappings":[{"from":0,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":2}]},{"pgid":"4.3c","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6809/563692809":"2024-04-18T02:23:38.171325+0000","172.21.15.17:6808/563692809":"2024-04-18T02:23:38.171325+0000","172.21.15.17:0/3759303517":"2024-04-18T02:23:38.171325+0000","172.21.15.17:0/160383134":"2024-04-18T02:23:45.908935+0000","172.21.15.17:0/1005366410":"2024-04-18T02:23:38.171325+0000","172.21.15.17:0/3236923389":"2024-04-18T02:23:38.171325+0000","172.21.15.17:0/3453247726":"2024-04-18T02:23:38.171325+0000","172.21.15.17:0/1654980936":"2024-04-18T02:23:45.908935+0000","172.21.15.17:6808/2667788284":"2024-04-18T02:23:45.908935+0000","172.21.15.17:0/2015426680":"2024-04-18T02:23:45.908935+0000","172.21.15.17:6809/2667788284":"2024-04-18T02:23:45.908935+0000","172.21.15.17:0/3707652691":"2024-04-18T02:23:45.908935+0000","172.21.15.17:0/3283324529":"2024-04-18T02:23:45.908935+0000","172.21.15.17:0/1035713232":"2024-04-18T02:23:45.908935+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T02:23:47.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.131+0000 7f94e6183640 10 mgrc shutdown 2024-04-17T02:23:47.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.131+0000 7f94e6183640 1 -- 172.21.15.17:0/2159915542 >> [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] conn(0x7f94c009f300 msgr2=0x7f94c00a17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:47.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.131+0000 7f94e6183640 1 --2- 172.21.15.17:0/2159915542 >> [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] conn(0x7f94c009f300 0x7f94c00a17c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009c00 tx=0x7f94d0009190 comp rx=0 tx=0).stop 2024-04-17T02:23:47.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.131+0000 7f94e6183640 1 -- 172.21.15.17:0/2159915542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94e0144db0 msgr2=0x7f94e01dad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:47.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.131+0000 7f94e6183640 1 --2- 172.21.15.17:0/2159915542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94e0144db0 0x7f94e01dad10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f94e01451e0 tx=0x7f94d800cb90 comp rx=0 tx=0).stop 2024-04-17T02:23:47.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.131+0000 7f94e6183640 1 -- 172.21.15.17:0/2159915542 shutdown_connections 2024-04-17T02:23:47.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.131+0000 7f94e6183640 1 --2- 172.21.15.17:0/2159915542 >> [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] conn(0x7f94c009f300 0x7f94c00a17c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:47.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.131+0000 7f94e6183640 1 --2- 172.21.15.17:0/2159915542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94e0144db0 0x7f94e01dad10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:47.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.131+0000 7f94e6183640 1 --2- 172.21.15.17:0/2159915542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94e00a9100 0x7f94e01da7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:47.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.131+0000 7f94e6183640 1 --2- 172.21.15.17:0/2159915542 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f94e0067560 0x7f94e00a0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:47.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.131+0000 7f94e6183640 1 -- 172.21.15.17:0/2159915542 >> 172.21.15.17:0/2159915542 conn(0x7f94e006b730 msgr2=0x7f94e00a4800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:23:47.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.131+0000 7f94e6183640 1 -- 172.21.15.17:0/2159915542 shutdown_connections 2024-04-17T02:23:47.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.131+0000 7f94e6183640 1 -- 172.21.15.17:0/2159915542 wait complete. 2024-04-17T02:23:47.144 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-17T02:23:47.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.248+0000 7fb34d01e640 1 Processor -- start 2024-04-17T02:23:47.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.248+0000 7fb34d01e640 1 -- start start 2024-04-17T02:23:47.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.249+0000 7fb34d01e640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb34813b540 0x7fb348148f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:47.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.249+0000 7fb34d01e640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb3480a9c00 0x7fb3480aa060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:47.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.249+0000 7fb34d01e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb348148870 con 0x7fb3480b8e30 2024-04-17T02:23:47.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.249+0000 7fb34d01e640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fb3480b9210 con 0x7fb3480a9c00 2024-04-17T02:23:47.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.249+0000 7fb34d01e640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fb34813bc90 con 0x7fb34813b540 2024-04-17T02:23:47.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.249+0000 7fb34659c640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb34813b540 0x7fb348148f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:47.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.249+0000 7fb346d9d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fb3480b8e30 0x7fb3480aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:57824/0 (socket says 172.21.15.17:57824) 2024-04-17T02:23:47.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.249+0000 7fb346d9d640 1 -- 172.21.15.17:0/1013849950 learned_addr learned my addr 172.21.15.17:0/1013849950 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-04-17T02:23:47.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.249+0000 7fb34659c640 1 -- 172.21.15.17:0/1013849950 >> v2:172.21.15.122:3300/0 conn(0x7fb3480a9c00 msgr2=0x7fb3480aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:23:47.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.249+0000 7fb34659c640 1 --2- 172.21.15.17:0/1013849950 >> v2:172.21.15.122:3300/0 conn(0x7fb3480a9c00 0x7fb3480aa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:47.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.249+0000 7fb345d9b640 1 -- 172.21.15.17:0/1013849950 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2286963422 0 0) 0x7fb348148870 con 0x7fb3480b8e30 2024-04-17T02:23:47.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.249+0000 7fb34659c640 1 -- 172.21.15.17:0/1013849950 >> v1:172.21.15.17:6789/0 conn(0x7fb3480b8e30 legacy=0x7fb3480aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:47.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.249+0000 7fb34659c640 1 -- 172.21.15.17:0/1013849950 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb348149490 con 0x7fb34813b540 2024-04-17T02:23:47.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.250+0000 7fb34659c640 1 --2- 172.21.15.17:0/1013849950 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb34813b540 0x7fb348148f50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb330009790 tx=0x7fb33002b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ce80be6f92d01da server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:47.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.250+0000 7fb345d9b640 1 -- 172.21.15.17:0/1013849950 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb330031770 con 0x7fb34813b540 2024-04-17T02:23:47.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.250+0000 7fb345d9b640 1 -- 172.21.15.17:0/1013849950 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb330037070 con 0x7fb34813b540 2024-04-17T02:23:47.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.250+0000 7fb345d9b640 1 -- 172.21.15.17:0/1013849950 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb330031b50 con 0x7fb34813b540 2024-04-17T02:23:47.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.250+0000 7fb34d01e640 1 -- 172.21.15.17:0/1013849950 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb34813b540 msgr2=0x7fb348148f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:47.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.250+0000 7fb34d01e640 1 --2- 172.21.15.17:0/1013849950 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb34813b540 0x7fb348148f50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb330009790 tx=0x7fb33002b810 comp rx=0 tx=0).stop 2024-04-17T02:23:47.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.251+0000 7fb34d01e640 1 -- 172.21.15.17:0/1013849950 shutdown_connections 2024-04-17T02:23:47.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.251+0000 7fb34d01e640 1 --2- 172.21.15.17:0/1013849950 >> v2:172.21.15.122:3300/0 conn(0x7fb3480a9c00 0x7fb3480aa060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:47.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.251+0000 7fb34d01e640 1 --2- 172.21.15.17:0/1013849950 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb34813b540 0x7fb348148f50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:47.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.251+0000 7fb34d01e640 1 -- 172.21.15.17:0/1013849950 >> 172.21.15.17:0/1013849950 conn(0x7fb3480741a0 msgr2=0x7fb3480745b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:23:47.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.251+0000 7fb34d01e640 1 -- 172.21.15.17:0/1013849950 shutdown_connections 2024-04-17T02:23:47.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.251+0000 7fb34d01e640 1 -- 172.21.15.17:0/1013849950 wait complete. 2024-04-17T02:23:47.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.252+0000 7fb34d01e640 1 Processor -- start 2024-04-17T02:23:47.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.252+0000 7fb34d01e640 1 -- start start 2024-04-17T02:23:47.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.252+0000 7fb34d01e640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb3480a9c00 0x7fb348139b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:47.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.252+0000 7fb34d01e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3480b8e30 0x7fb3480a2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:47.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.252+0000 7fb34d01e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb34813b540 0x7fb3481455a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:47.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.252+0000 7fb34d01e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb34814fdb0 con 0x7fb3480b8e30 2024-04-17T02:23:47.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.252+0000 7fb34d01e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb34814fc30 con 0x7fb34813b540 2024-04-17T02:23:47.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.252+0000 7fb34d01e640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7fb34814ff30 con 0x7fb3480a9c00 2024-04-17T02:23:47.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.253+0000 7fb34659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3480b8e30 0x7fb3480a2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:47.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.253+0000 7fb346d9d640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb3480a9c00 0x7fb348139b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:47.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.253+0000 7fb34659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3480b8e30 0x7fb3480a2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58694/0 (socket says 172.21.15.17:58694) 2024-04-17T02:23:47.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.253+0000 7fb34659c640 1 -- 172.21.15.17:0/3335524371 learned_addr learned my addr 172.21.15.17:0/3335524371 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:23:47.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.253+0000 7fb346d9d640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb3480a9c00 0x7fb348139b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:38190/0 (socket says 172.21.15.17:38190) 2024-04-17T02:23:47.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.253+0000 7fb34759e640 1 --2- 172.21.15.17:0/3335524371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb34813b540 0x7fb3481455a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:47.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.253+0000 7fb346d9d640 1 -- 172.21.15.17:0/3335524371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb34813b540 msgr2=0x7fb3481455a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:47.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.253+0000 7fb346d9d640 1 --2- 172.21.15.17:0/3335524371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb34813b540 0x7fb3481455a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:47.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.253+0000 7fb346d9d640 1 -- 172.21.15.17:0/3335524371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3480b8e30 msgr2=0x7fb3480a2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:47.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.253+0000 7fb346d9d640 1 --2- 172.21.15.17:0/3335524371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3480b8e30 0x7fb3480a2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:47.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.253+0000 7fb346d9d640 1 -- 172.21.15.17:0/3335524371 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3480a3f40 con 0x7fb3480a9c00 2024-04-17T02:23:47.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.253+0000 7fb34659c640 1 --2- 172.21.15.17:0/3335524371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3480b8e30 0x7fb3480a2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:23:47.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.253+0000 7fb346d9d640 1 --2- 172.21.15.17:0/3335524371 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb3480a9c00 0x7fb348139b80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb348148a40 tx=0x7fb34000a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:47.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.253+0000 7fb33f7fe640 1 -- 172.21.15.17:0/3335524371 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb340017070 con 0x7fb3480a9c00 2024-04-17T02:23:47.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.253+0000 7fb33f7fe640 1 -- 172.21.15.17:0/3335524371 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb34000aca0 con 0x7fb3480a9c00 2024-04-17T02:23:47.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.253+0000 7fb34d01e640 1 -- 172.21.15.17:0/3335524371 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3480a4200 con 0x7fb3480a9c00 2024-04-17T02:23:47.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.253+0000 7fb33f7fe640 1 -- 172.21.15.17:0/3335524371 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb340012660 con 0x7fb3480a9c00 2024-04-17T02:23:47.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.253+0000 7fb34d01e640 1 -- 172.21.15.17:0/3335524371 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3480a3700 con 0x7fb3480a9c00 2024-04-17T02:23:47.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.254+0000 7fb34d01e640 1 -- 172.21.15.17:0/3335524371 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3480687f0 con 0x7fb3480a9c00 2024-04-17T02:23:47.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.255+0000 7fb33f7fe640 1 -- 172.21.15.17:0/3335524371 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 14) ==== 134755+0+0 (secure 0 0 0) 0x7fb34001a070 con 0x7fb3480a9c00 2024-04-17T02:23:47.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.255+0000 7fb33f7fe640 20 mgrc handle_mgr_map mgrmap(e 14) 2024-04-17T02:23:47.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.256+0000 7fb33f7fe640 4 mgrc handle_mgr_map Got map version 14 2024-04-17T02:23:47.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.256+0000 7fb33f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] 2024-04-17T02:23:47.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.256+0000 7fb33f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] 2024-04-17T02:23:47.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.256+0000 7fb33f7fe640 1 --2- 172.21.15.17:0/3335524371 >> [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] conn(0x7fb32809f250 0x7fb3280a1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:47.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.256+0000 7fb34659c640 1 --2- 172.21.15.17:0/3335524371 >> [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] conn(0x7fb32809f250 0x7fb3280a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:47.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.256+0000 7fb33f7fe640 1 -- 172.21.15.17:0/3335524371 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 5227+0+0 (secure 0 0 0) 0x7fb3400c9270 con 0x7fb3480a9c00 2024-04-17T02:23:47.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.256+0000 7fb34659c640 1 --2- 172.21.15.17:0/3335524371 >> [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] conn(0x7fb32809f250 0x7fb3280a1710 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb330009790 tx=0x7fb330008030 comp rx=0 tx=0).ready entity=mgr.4776 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:47.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.260+0000 7fb33f7fe640 1 -- 172.21.15.17:0/3335524371 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb34004de10 con 0x7fb3480a9c00 2024-04-17T02:23:47.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.478+0000 7fb34d01e640 1 -- 172.21.15.17:0/3335524371 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb3480a5d70 con 0x7fb3480a9c00 2024-04-17T02:23:47.484 INFO:tasks.ceph.mds.a.smithi017.stderr: -800> 2024-04-17T02:22:28.236+0000 7fb8623af640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-17T02:23:47.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.484+0000 7fb33f7fe640 1 -- 172.21.15.17:0/3335524371 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) ==== 161+0+0 (secure 0 0 0) 0x7fb340097c40 con 0x7fb3480a9c00 2024-04-17T02:23:47.485 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-17T02:23:47.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.486+0000 7fb34d01e640 10 mgrc shutdown 2024-04-17T02:23:47.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.486+0000 7fb34d01e640 1 -- 172.21.15.17:0/3335524371 >> [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] conn(0x7fb32809f250 msgr2=0x7fb3280a1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:47.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.486+0000 7fb34d01e640 1 --2- 172.21.15.17:0/3335524371 >> [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] conn(0x7fb32809f250 0x7fb3280a1710 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb330009790 tx=0x7fb330008030 comp rx=0 tx=0).stop 2024-04-17T02:23:47.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.486+0000 7fb34d01e640 1 -- 172.21.15.17:0/3335524371 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb3480a9c00 msgr2=0x7fb348139b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:47.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.486+0000 7fb34d01e640 1 --2- 172.21.15.17:0/3335524371 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb3480a9c00 0x7fb348139b80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb348148a40 tx=0x7fb34000a060 comp rx=0 tx=0).stop 2024-04-17T02:23:47.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.486+0000 7fb34d01e640 1 -- 172.21.15.17:0/3335524371 shutdown_connections 2024-04-17T02:23:47.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.486+0000 7fb34d01e640 1 --2- 172.21.15.17:0/3335524371 >> [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] conn(0x7fb32809f250 0x7fb3280a1710 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:47.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.486+0000 7fb34d01e640 1 --2- 172.21.15.17:0/3335524371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3480b8e30 0x7fb3480a2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:47.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.486+0000 7fb34d01e640 1 --2- 172.21.15.17:0/3335524371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb34813b540 0x7fb3481455a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:47.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.486+0000 7fb34d01e640 1 --2- 172.21.15.17:0/3335524371 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7fb3480a9c00 0x7fb348139b80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:47.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.486+0000 7fb34d01e640 1 -- 172.21.15.17:0/3335524371 >> 172.21.15.17:0/3335524371 conn(0x7fb3480741a0 msgr2=0x7fb348072220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:23:47.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.486+0000 7fb34d01e640 1 -- 172.21.15.17:0/3335524371 shutdown_connections 2024-04-17T02:23:47.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.486+0000 7fb34d01e640 1 -- 172.21.15.17:0/3335524371 wait complete. 2024-04-17T02:23:47.499 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-17T02:23:47.508 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2024-04-17T02:23:47.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.604+0000 7f31abf7a640 1 Processor -- start 2024-04-17T02:23:47.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.604+0000 7f31abf7a640 1 -- start start 2024-04-17T02:23:47.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.605+0000 7f31abf7a640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f31a40ab3b0 0x7f31a40ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:47.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.605+0000 7f31abf7a640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f31a40acce0 0x7f31a414f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:47.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.605+0000 7f31abf7a640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31a40a7f00 con 0x7f31a40a9560 2024-04-17T02:23:47.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.605+0000 7f31abf7a640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f31a40abd20 con 0x7f31a40ab3b0 2024-04-17T02:23:47.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.605+0000 7f31abf7a640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f31a40ac000 con 0x7f31a40acce0 2024-04-17T02:23:47.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.605+0000 7f31a9d16640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f31a40ab3b0 0x7f31a40ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:47.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.605+0000 7f31aa517640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f31a40acce0 0x7f31a414f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:47.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.605+0000 7f31a9d16640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f31a40ab3b0 0x7f31a40ac7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58710/0 (socket says 172.21.15.17:58710) 2024-04-17T02:23:47.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.605+0000 7f31a9d16640 1 -- 172.21.15.17:0/539285482 learned_addr learned my addr 172.21.15.17:0/539285482 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:23:47.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.605+0000 7f31aa517640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f31a40acce0 0x7f31a414f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:38210/0 (socket says 172.21.15.17:38210) 2024-04-17T02:23:47.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.605+0000 7f31a9515640 1 --1- 172.21.15.17:0/539285482 >> v1:172.21.15.17:6789/0 conn(0x7f31a40a9560 0x7f31a4145730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:57838/0 (socket says 172.21.15.17:57838) 2024-04-17T02:23:47.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.605+0000 7f31aa517640 1 -- 172.21.15.17:0/539285482 >> v2:172.21.15.17:3300/0 conn(0x7f31a40ab3b0 msgr2=0x7f31a40ac7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:23:47.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.605+0000 7f31aa517640 1 --2- 172.21.15.17:0/539285482 >> v2:172.21.15.17:3300/0 conn(0x7f31a40ab3b0 0x7f31a40ac7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:47.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.605+0000 7f31aa517640 1 -- 172.21.15.17:0/539285482 >> v1:172.21.15.17:6789/0 conn(0x7f31a40a9560 legacy=0x7f31a4145730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:47.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.605+0000 7f31aa517640 1 -- 172.21.15.17:0/539285482 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31a40a7960 con 0x7f31a40acce0 2024-04-17T02:23:47.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.605+0000 7f31a9d16640 1 --2- 172.21.15.17:0/539285482 >> v2:172.21.15.17:3300/0 conn(0x7f31a40ab3b0 0x7f31a40ac7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:23:47.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.606+0000 7f31aa517640 1 --2- 172.21.15.17:0/539285482 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f31a40acce0 0x7f31a414f960 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3194009dc0 tx=0x7f319402be00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c41114c2ea92e153 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:47.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.606+0000 7f31a8d14640 1 -- 172.21.15.17:0/539285482 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3194039070 con 0x7f31a40acce0 2024-04-17T02:23:47.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.606+0000 7f31a8d14640 1 -- 172.21.15.17:0/539285482 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f319402cbb0 con 0x7f31a40acce0 2024-04-17T02:23:47.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.606+0000 7f31a8d14640 1 -- 172.21.15.17:0/539285482 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3194034440 con 0x7f31a40acce0 2024-04-17T02:23:47.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.607+0000 7f31abf7a640 1 -- 172.21.15.17:0/539285482 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f31a40acce0 msgr2=0x7f31a414f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:47.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.607+0000 7f31abf7a640 1 --2- 172.21.15.17:0/539285482 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f31a40acce0 0x7f31a414f960 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3194009dc0 tx=0x7f319402be00 comp rx=0 tx=0).stop 2024-04-17T02:23:47.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.607+0000 7f31abf7a640 1 -- 172.21.15.17:0/539285482 shutdown_connections 2024-04-17T02:23:47.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.607+0000 7f31abf7a640 1 --2- 172.21.15.17:0/539285482 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f31a40acce0 0x7f31a414f960 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:47.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.607+0000 7f31abf7a640 1 --2- 172.21.15.17:0/539285482 >> v2:172.21.15.17:3300/0 conn(0x7f31a40ab3b0 0x7f31a40ac7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:47.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.607+0000 7f31abf7a640 1 -- 172.21.15.17:0/539285482 >> 172.21.15.17:0/539285482 conn(0x7f31a40a9b60 msgr2=0x7f31a40a9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:23:47.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.607+0000 7f31abf7a640 1 -- 172.21.15.17:0/539285482 shutdown_connections 2024-04-17T02:23:47.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.607+0000 7f31abf7a640 1 -- 172.21.15.17:0/539285482 wait complete. 2024-04-17T02:23:47.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.608+0000 7f31abf7a640 1 Processor -- start 2024-04-17T02:23:47.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.608+0000 7f31abf7a640 1 -- start start 2024-04-17T02:23:47.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.608+0000 7f31abf7a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31a40a9560 0x7f31a4144240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:47.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.608+0000 7f31abf7a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31a40ab3b0 0x7f31a414a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:47.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.609+0000 7f31abf7a640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f31a40acce0 0x7f31a4136280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:47.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.609+0000 7f31abf7a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f31a406b5b0 con 0x7f31a40a9560 2024-04-17T02:23:47.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.609+0000 7f31abf7a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f31a4145e40 con 0x7f31a40ab3b0 2024-04-17T02:23:47.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.609+0000 7f31abf7a640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f31a4149b10 con 0x7f31a40acce0 2024-04-17T02:23:47.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.609+0000 7f31a9d16640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31a40a9560 0x7f31a4144240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:47.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.609+0000 7f31aa517640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f31a40acce0 0x7f31a4136280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:47.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.609+0000 7f31a9d16640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31a40a9560 0x7f31a4144240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58724/0 (socket says 172.21.15.17:58724) 2024-04-17T02:23:47.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.609+0000 7f31a9d16640 1 -- 172.21.15.17:0/3211896870 learned_addr learned my addr 172.21.15.17:0/3211896870 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:23:47.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.609+0000 7f31aa517640 1 -- 172.21.15.17:0/3211896870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31a40ab3b0 msgr2=0x7f31a414a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:47.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.609+0000 7f31aa517640 1 --2- 172.21.15.17:0/3211896870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31a40ab3b0 0x7f31a414a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:47.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.609+0000 7f31aa517640 1 -- 172.21.15.17:0/3211896870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31a40a9560 msgr2=0x7f31a4144240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:47.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.609+0000 7f31aa517640 1 --2- 172.21.15.17:0/3211896870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31a40a9560 0x7f31a4144240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:47.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.609+0000 7f31aa517640 1 -- 172.21.15.17:0/3211896870 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31a41367c0 con 0x7f31a40acce0 2024-04-17T02:23:47.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.609+0000 7f31aa517640 1 --2- 172.21.15.17:0/3211896870 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f31a40acce0 0x7f31a4136280 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3194033000 tx=0x7f3194004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:47.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.609+0000 7f31a27fc640 1 -- 172.21.15.17:0/3211896870 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3194039050 con 0x7f31a40acce0 2024-04-17T02:23:47.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.609+0000 7f31a27fc640 1 -- 172.21.15.17:0/3211896870 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3194045070 con 0x7f31a40acce0 2024-04-17T02:23:47.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.609+0000 7f31abf7a640 1 -- 172.21.15.17:0/3211896870 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31a4136a40 con 0x7f31a40acce0 2024-04-17T02:23:47.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.609+0000 7f31a27fc640 1 -- 172.21.15.17:0/3211896870 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f319403e850 con 0x7f31a40acce0 2024-04-17T02:23:47.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.609+0000 7f31abf7a640 1 -- 172.21.15.17:0/3211896870 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f31a413a020 con 0x7f31a40acce0 2024-04-17T02:23:47.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.610+0000 7f31abf7a640 1 -- 172.21.15.17:0/3211896870 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31a40687f0 con 0x7f31a40acce0 2024-04-17T02:23:47.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.611+0000 7f31a27fc640 1 -- 172.21.15.17:0/3211896870 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 14) ==== 134755+0+0 (secure 0 0 0) 0x7f319403e9f0 con 0x7f31a40acce0 2024-04-17T02:23:47.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.611+0000 7f31a27fc640 20 mgrc handle_mgr_map mgrmap(e 14) 2024-04-17T02:23:47.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.612+0000 7f31a27fc640 4 mgrc handle_mgr_map Got map version 14 2024-04-17T02:23:47.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.612+0000 7f31a27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] 2024-04-17T02:23:47.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.612+0000 7f31a27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] 2024-04-17T02:23:47.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.612+0000 7f31a27fc640 1 --2- 172.21.15.17:0/3211896870 >> [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] conn(0x7f319009f2d0 0x7f31900a1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:47.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.612+0000 7f31a9d16640 1 --2- 172.21.15.17:0/3211896870 >> [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] conn(0x7f319009f2d0 0x7f31900a1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:47.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.612+0000 7f31a27fc640 1 -- 172.21.15.17:0/3211896870 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(31..31 src has 1..31) ==== 5313+0+0 (secure 0 0 0) 0x7f31940ec210 con 0x7f31a40acce0 2024-04-17T02:23:47.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.612+0000 7f31a9d16640 1 --2- 172.21.15.17:0/3211896870 >> [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] conn(0x7f319009f2d0 0x7f31900a1790 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f319c009630 tx=0x7f319c009240 comp rx=0 tx=0).ready entity=mgr.4776 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:47.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.616+0000 7f31a27fc640 1 -- 172.21.15.17:0/3211896870 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f31a41367c0 con 0x7f31a40acce0 2024-04-17T02:23:47.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:47.840+0000 7f31abf7a640 1 -- 172.21.15.17:0/3211896870 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f31a40a51f0 con 0x7f31a40acce0 2024-04-17T02:23:48.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.484+0000 7f31a27fc640 1 -- 172.21.15.17:0/3211896870 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) ==== 104+0+0 (secure 0 0 0) 0x7f31940bb1d0 con 0x7f31a40acce0 2024-04-17T02:23:48.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.486+0000 7f31abf7a640 10 mgrc shutdown 2024-04-17T02:23:48.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.486+0000 7f31abf7a640 1 -- 172.21.15.17:0/3211896870 >> [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] conn(0x7f319009f2d0 msgr2=0x7f31900a1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:48.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.486+0000 7f31abf7a640 1 --2- 172.21.15.17:0/3211896870 >> [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] conn(0x7f319009f2d0 0x7f31900a1790 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f319c009630 tx=0x7f319c009240 comp rx=0 tx=0).stop 2024-04-17T02:23:48.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.487+0000 7f31abf7a640 1 -- 172.21.15.17:0/3211896870 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f31a40acce0 msgr2=0x7f31a4136280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:48.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.487+0000 7f31abf7a640 1 --2- 172.21.15.17:0/3211896870 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f31a40acce0 0x7f31a4136280 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3194033000 tx=0x7f3194004a40 comp rx=0 tx=0).stop 2024-04-17T02:23:48.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.487+0000 7f31abf7a640 1 -- 172.21.15.17:0/3211896870 shutdown_connections 2024-04-17T02:23:48.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.487+0000 7f31abf7a640 1 --2- 172.21.15.17:0/3211896870 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f31a40acce0 0x7f31a4136280 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:48.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.487+0000 7f31abf7a640 1 --2- 172.21.15.17:0/3211896870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31a40ab3b0 0x7f31a414a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:48.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.487+0000 7f31abf7a640 1 --2- 172.21.15.17:0/3211896870 >> [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] conn(0x7f319009f2d0 0x7f31900a1790 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:48.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.487+0000 7f31abf7a640 1 --2- 172.21.15.17:0/3211896870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31a40a9560 0x7f31a4144240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:48.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.487+0000 7f31abf7a640 1 -- 172.21.15.17:0/3211896870 >> 172.21.15.17:0/3211896870 conn(0x7f31a40a9b60 msgr2=0x7f31a40a8100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:23:48.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.487+0000 7f31abf7a640 1 -- 172.21.15.17:0/3211896870 shutdown_connections 2024-04-17T02:23:48.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.487+0000 7f31abf7a640 1 -- 172.21.15.17:0/3211896870 wait complete. 2024-04-17T02:23:48.506 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-17T02:23:48.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.656+0000 7f2224e64640 1 Processor -- start 2024-04-17T02:23:48.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.656+0000 7f2224e64640 1 -- start start 2024-04-17T02:23:48.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.656+0000 7f2224e64640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f2220144a20 0x7f2220148490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:48.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.656+0000 7f2224e64640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f22200a8310 0x7f22200b74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:48.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.656+0000 7f2224e64640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2220148d00 con 0x7f22200a9210 2024-04-17T02:23:48.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.656+0000 7f2224e64640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f2220144e00 con 0x7f22200a8310 2024-04-17T02:23:48.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.656+0000 7f2224e64640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f2220148fc0 con 0x7f2220144a20 2024-04-17T02:23:48.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.657+0000 7f221e59c640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f2220144a20 0x7f2220148490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:48.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.657+0000 7f221e59c640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f2220144a20 0x7f2220148490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:38262/0 (socket says 172.21.15.17:38262) 2024-04-17T02:23:48.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.657+0000 7f221e59c640 1 -- 172.21.15.17:0/1641121741 learned_addr learned my addr 172.21.15.17:0/1641121741 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:23:48.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.657+0000 7f221dd9b640 1 --2- 172.21.15.17:0/1641121741 >> v2:172.21.15.122:3300/0 conn(0x7f22200a8310 0x7f22200b74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:48.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.657+0000 7f221e59c640 1 -- 172.21.15.17:0/1641121741 >> v2:172.21.15.122:3300/0 conn(0x7f22200a8310 msgr2=0x7f22200b74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:23:48.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.657+0000 7f221e59c640 1 --2- 172.21.15.17:0/1641121741 >> v2:172.21.15.122:3300/0 conn(0x7f22200a8310 0x7f22200b74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:48.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.657+0000 7f221e59c640 1 -- 172.21.15.17:0/1641121741 >> v1:172.21.15.122:6789/0 conn(0x7f22200a9210 legacy=0x7f222006cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:48.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.657+0000 7f221e59c640 1 -- 172.21.15.17:0/1641121741 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22201489d0 con 0x7f2220144a20 2024-04-17T02:23:48.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.658+0000 7f221e59c640 1 --2- 172.21.15.17:0/1641121741 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f2220144a20 0x7f2220148490 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2210009870 tx=0x7f221002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8adcff753ad9543 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:48.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.658+0000 7f221d59a640 1 -- 172.21.15.17:0/1641121741 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2210034070 con 0x7f2220144a20 2024-04-17T02:23:48.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.658+0000 7f221d59a640 1 -- 172.21.15.17:0/1641121741 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2210030840 con 0x7f2220144a20 2024-04-17T02:23:48.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.658+0000 7f221d59a640 1 -- 172.21.15.17:0/1641121741 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2210030c30 con 0x7f2220144a20 2024-04-17T02:23:48.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.658+0000 7f2224e64640 1 -- 172.21.15.17:0/1641121741 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f2220144a20 msgr2=0x7f2220148490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:48.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.658+0000 7f2224e64640 1 --2- 172.21.15.17:0/1641121741 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f2220144a20 0x7f2220148490 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2210009870 tx=0x7f221002b980 comp rx=0 tx=0).stop 2024-04-17T02:23:48.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.658+0000 7f2224e64640 1 -- 172.21.15.17:0/1641121741 shutdown_connections 2024-04-17T02:23:48.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.658+0000 7f2224e64640 1 --2- 172.21.15.17:0/1641121741 >> v2:172.21.15.122:3300/0 conn(0x7f22200a8310 0x7f22200b74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:48.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.658+0000 7f2224e64640 1 --2- 172.21.15.17:0/1641121741 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f2220144a20 0x7f2220148490 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:48.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.658+0000 7f2224e64640 1 -- 172.21.15.17:0/1641121741 >> 172.21.15.17:0/1641121741 conn(0x7f22200a66f0 msgr2=0x7f22200b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:23:48.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.658+0000 7f2224e64640 1 -- 172.21.15.17:0/1641121741 shutdown_connections 2024-04-17T02:23:48.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.658+0000 7f2224e64640 1 -- 172.21.15.17:0/1641121741 wait complete. 2024-04-17T02:23:48.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.660+0000 7f2224e64640 1 Processor -- start 2024-04-17T02:23:48.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.660+0000 7f2224e64640 1 -- start start 2024-04-17T02:23:48.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.660+0000 7f2224e64640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22200a8310 0x7f22201ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:48.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.660+0000 7f2224e64640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22200a9210 0x7f22201da770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:48.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.660+0000 7f2224e64640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f2220144a20 0x7f22201dacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:48.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.660+0000 7f2224e64640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f22200b7ac0 con 0x7f22200a9210 2024-04-17T02:23:48.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.660+0000 7f2224e64640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f22200a7b50 con 0x7f22200a8310 2024-04-17T02:23:48.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.660+0000 7f2224e64640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f22200a7cd0 con 0x7f2220144a20 2024-04-17T02:23:48.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.660+0000 7f221ed9d640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f2220144a20 0x7f22201dacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:48.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.660+0000 7f221dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22200a9210 0x7f22201da770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:48.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.660+0000 7f221ed9d640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f2220144a20 0x7f22201dacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:38270/0 (socket says 172.21.15.17:38270) 2024-04-17T02:23:48.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.660+0000 7f221ed9d640 1 -- 172.21.15.17:0/609123871 learned_addr learned my addr 172.21.15.17:0/609123871 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:23:48.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.660+0000 7f221e59c640 1 --2- 172.21.15.17:0/609123871 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22200a8310 0x7f22201ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:48.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.661+0000 7f221ed9d640 1 -- 172.21.15.17:0/609123871 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22200a8310 msgr2=0x7f22201ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:48.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.661+0000 7f221ed9d640 1 --2- 172.21.15.17:0/609123871 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22200a8310 0x7f22201ce4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:48.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.661+0000 7f221ed9d640 1 -- 172.21.15.17:0/609123871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22200a9210 msgr2=0x7f22201da770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:48.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.661+0000 7f221ed9d640 1 --2- 172.21.15.17:0/609123871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22200a9210 0x7f22201da770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:48.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.661+0000 7f221ed9d640 1 -- 172.21.15.17:0/609123871 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22200a3390 con 0x7f2220144a20 2024-04-17T02:23:48.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.661+0000 7f221dd9b640 1 --2- 172.21.15.17:0/609123871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22200a9210 0x7f22201da770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:23:48.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.661+0000 7f221ed9d640 1 --2- 172.21.15.17:0/609123871 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f2220144a20 0x7f22201dacb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f221800c760 tx=0x7f221800cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:48.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.661+0000 7f220effd640 1 -- 172.21.15.17:0/609123871 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2218003b70 con 0x7f2220144a20 2024-04-17T02:23:48.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.661+0000 7f220effd640 1 -- 172.21.15.17:0/609123871 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2218003d10 con 0x7f2220144a20 2024-04-17T02:23:48.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.661+0000 7f2224e64640 1 -- 172.21.15.17:0/609123871 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22201db450 con 0x7f2220144a20 2024-04-17T02:23:48.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.661+0000 7f220effd640 1 -- 172.21.15.17:0/609123871 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f221800aab0 con 0x7f2220144a20 2024-04-17T02:23:48.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.661+0000 7f2224e64640 1 -- 172.21.15.17:0/609123871 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f22201444d0 con 0x7f2220144a20 2024-04-17T02:23:48.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.662+0000 7f2224e64640 1 -- 172.21.15.17:0/609123871 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2220068890 con 0x7f2220144a20 2024-04-17T02:23:48.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.663+0000 7f220effd640 1 -- 172.21.15.17:0/609123871 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 15) ==== 134963+0+0 (secure 0 0 0) 0x7f221800ac50 con 0x7f2220144a20 2024-04-17T02:23:48.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.663+0000 7f220effd640 20 mgrc handle_mgr_map mgrmap(e 15) 2024-04-17T02:23:48.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.664+0000 7f220effd640 4 mgrc handle_mgr_map Got map version 15 2024-04-17T02:23:48.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.664+0000 7f220effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] 2024-04-17T02:23:48.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.664+0000 7f220effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] 2024-04-17T02:23:48.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.664+0000 7f220effd640 1 --2- 172.21.15.17:0/609123871 >> [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] conn(0x7f220009f510 0x7f22000a19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:48.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.664+0000 7f221e59c640 1 --2- 172.21.15.17:0/609123871 >> [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] conn(0x7f220009f510 0x7f22000a19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:48.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.664+0000 7f220effd640 1 -- 172.21.15.17:0/609123871 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(31..31 src has 1..31) ==== 5313+0+0 (secure 0 0 0) 0x7f22180c9890 con 0x7f2220144a20 2024-04-17T02:23:48.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.664+0000 7f221e59c640 1 --2- 172.21.15.17:0/609123871 >> [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] conn(0x7f220009f510 0x7f22000a19d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2210036000 tx=0x7f221003b040 comp rx=0 tx=0).ready entity=mgr.4776 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:48.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.668+0000 7f220effd640 1 -- 172.21.15.17:0/609123871 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f2218098420 con 0x7f2220144a20 2024-04-17T02:23:48.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:48.850+0000 7f2224e64640 1 -- 172.21.15.17:0/609123871 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f222009de50 con 0x7f2220144a20 2024-04-17T02:23:49.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.493+0000 7f220effd640 1 -- 172.21.15.17:0/609123871 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v32) ==== 181+0+0 (secure 0 0 0) 0x7f2218097d20 con 0x7f2220144a20 2024-04-17T02:23:49.494 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2024-04-17T02:23:49.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.497+0000 7f2224e64640 10 mgrc shutdown 2024-04-17T02:23:49.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.497+0000 7f2224e64640 1 -- 172.21.15.17:0/609123871 >> [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] conn(0x7f220009f510 msgr2=0x7f22000a19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:49.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.497+0000 7f2224e64640 1 --2- 172.21.15.17:0/609123871 >> [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] conn(0x7f220009f510 0x7f22000a19d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2210036000 tx=0x7f221003b040 comp rx=0 tx=0).stop 2024-04-17T02:23:49.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.497+0000 7f2224e64640 1 -- 172.21.15.17:0/609123871 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f2220144a20 msgr2=0x7f22201dacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:49.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.497+0000 7f2224e64640 1 --2- 172.21.15.17:0/609123871 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f2220144a20 0x7f22201dacb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f221800c760 tx=0x7f221800cc20 comp rx=0 tx=0).stop 2024-04-17T02:23:49.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.497+0000 7f2224e64640 1 -- 172.21.15.17:0/609123871 shutdown_connections 2024-04-17T02:23:49.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.497+0000 7f2224e64640 1 --2- 172.21.15.17:0/609123871 >> [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] conn(0x7f220009f510 0x7f22000a19d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:49.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.497+0000 7f2224e64640 1 --2- 172.21.15.17:0/609123871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22200a9210 0x7f22201da770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:49.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.497+0000 7f2224e64640 1 --2- 172.21.15.17:0/609123871 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f2220144a20 0x7f22201dacb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:49.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.497+0000 7f2224e64640 1 --2- 172.21.15.17:0/609123871 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22200a8310 0x7f22201ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:49.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.497+0000 7f2224e64640 1 -- 172.21.15.17:0/609123871 >> 172.21.15.17:0/609123871 conn(0x7f22200a66f0 msgr2=0x7f222006b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:23:49.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.497+0000 7f2224e64640 1 -- 172.21.15.17:0/609123871 shutdown_connections 2024-04-17T02:23:49.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.497+0000 7f2224e64640 1 -- 172.21.15.17:0/609123871 wait complete. 2024-04-17T02:23:49.513 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-17T02:23:49.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.625+0000 7f13ece64640 1 Processor -- start 2024-04-17T02:23:49.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.626+0000 7f13ece64640 1 -- start start 2024-04-17T02:23:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.626+0000 7f13ece64640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f13e806b370 0x7f13e80a1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.626+0000 7f13ece64640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f13e8143a20 0x7f13e814d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.626+0000 7f13ece64640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e80a4e40 con 0x7f13e80a4760 2024-04-17T02:23:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.626+0000 7f13ece64640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f13e806b750 con 0x7f13e8143a20 2024-04-17T02:23:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.626+0000 7f13ece64640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f13e80a5100 con 0x7f13e806b370 2024-04-17T02:23:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.626+0000 7f13e6d9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f13e8143a20 0x7f13e814d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.626+0000 7f13e659c640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f13e806b370 0x7f13e80a1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.626+0000 7f13e6d9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f13e8143a20 0x7f13e814d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58750/0 (socket says 172.21.15.17:58750) 2024-04-17T02:23:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.626+0000 7f13e6d9d640 1 -- 172.21.15.17:0/2848279214 learned_addr learned my addr 172.21.15.17:0/2848279214 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:23:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.627+0000 7f13e659c640 1 -- 172.21.15.17:0/2848279214 >> v2:172.21.15.17:3300/0 conn(0x7f13e8143a20 msgr2=0x7f13e814d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:23:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.627+0000 7f13e659c640 1 --2- 172.21.15.17:0/2848279214 >> v2:172.21.15.17:3300/0 conn(0x7f13e8143a20 0x7f13e814d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.627+0000 7f13e659c640 1 -- 172.21.15.17:0/2848279214 >> v1:172.21.15.122:6789/0 conn(0x7f13e80a4760 legacy=0x7f13e8143310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T02:23:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.627+0000 7f13e659c640 1 -- 172.21.15.17:0/2848279214 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e80a4b80 con 0x7f13e806b370 2024-04-17T02:23:49.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.627+0000 7f13e6d9d640 1 --2- 172.21.15.17:0/2848279214 >> v2:172.21.15.17:3300/0 conn(0x7f13e8143a20 0x7f13e814d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:23:49.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.627+0000 7f13e659c640 1 --2- 172.21.15.17:0/2848279214 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f13e806b370 0x7f13e80a1c60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f13d80097a0 tx=0x7f13d802b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90bec1727423e29d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:49.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.628+0000 7f13e5d9b640 1 -- 172.21.15.17:0/2848279214 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d8038070 con 0x7f13e806b370 2024-04-17T02:23:49.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.628+0000 7f13e5d9b640 1 -- 172.21.15.17:0/2848279214 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f13d8031700 con 0x7f13e806b370 2024-04-17T02:23:49.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.628+0000 7f13e5d9b640 1 -- 172.21.15.17:0/2848279214 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d8031af0 con 0x7f13e806b370 2024-04-17T02:23:49.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.628+0000 7f13ece64640 1 -- 172.21.15.17:0/2848279214 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f13e806b370 msgr2=0x7f13e80a1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:49.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.628+0000 7f13ece64640 1 --2- 172.21.15.17:0/2848279214 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f13e806b370 0x7f13e80a1c60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f13d80097a0 tx=0x7f13d802b7a0 comp rx=0 tx=0).stop 2024-04-17T02:23:49.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.628+0000 7f13ece64640 1 -- 172.21.15.17:0/2848279214 shutdown_connections 2024-04-17T02:23:49.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.628+0000 7f13ece64640 1 --2- 172.21.15.17:0/2848279214 >> v2:172.21.15.17:3300/0 conn(0x7f13e8143a20 0x7f13e814d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:49.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.628+0000 7f13ece64640 1 --2- 172.21.15.17:0/2848279214 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f13e806b370 0x7f13e80a1c60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:49.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.628+0000 7f13ece64640 1 -- 172.21.15.17:0/2848279214 >> 172.21.15.17:0/2848279214 conn(0x7f13e80a6960 msgr2=0x7f13e80a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:23:49.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.628+0000 7f13ece64640 1 -- 172.21.15.17:0/2848279214 shutdown_connections 2024-04-17T02:23:49.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.628+0000 7f13ece64640 1 -- 172.21.15.17:0/2848279214 wait complete. 2024-04-17T02:23:49.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.629+0000 7f13ece64640 1 Processor -- start 2024-04-17T02:23:49.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.629+0000 7f13ece64640 1 -- start start 2024-04-17T02:23:49.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.630+0000 7f13ece64640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f13e806b370 0x7f13e8141cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:49.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.630+0000 7f13ece64640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13e80a4760 0x7f13e80b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:49.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.630+0000 7f13ece64640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13e8143a20 0x7f13e8072430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:49.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.630+0000 7f13ece64640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f13e806eec0 con 0x7f13e80a4760 2024-04-17T02:23:49.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.630+0000 7f13ece64640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f13e806ed40 con 0x7f13e8143a20 2024-04-17T02:23:49.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.630+0000 7f13ece64640 1 -- --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_getmap magic: 0 -- 0x7f13e80a1660 con 0x7f13e806b370 2024-04-17T02:23:49.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.630+0000 7f13e659c640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f13e806b370 0x7f13e8141cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:49.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.630+0000 7f13e659c640 1 --2- >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f13e806b370 0x7f13e8141cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3301/0 says I am v2:172.21.15.17:38288/0 (socket says 172.21.15.17:38288) 2024-04-17T02:23:49.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.630+0000 7f13e659c640 1 -- 172.21.15.17:0/1898863994 learned_addr learned my addr 172.21.15.17:0/1898863994 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-04-17T02:23:49.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.630+0000 7f13dffff640 1 --2- 172.21.15.17:0/1898863994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13e80a4760 0x7f13e80b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:49.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.630+0000 7f13e6d9d640 1 --2- 172.21.15.17:0/1898863994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13e8143a20 0x7f13e8072430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:49.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.630+0000 7f13e659c640 1 -- 172.21.15.17:0/1898863994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13e8143a20 msgr2=0x7f13e8072430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:49.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.630+0000 7f13e659c640 1 --2- 172.21.15.17:0/1898863994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13e8143a20 0x7f13e8072430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:49.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.630+0000 7f13e659c640 1 -- 172.21.15.17:0/1898863994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13e80a4760 msgr2=0x7f13e80b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:49.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.630+0000 7f13e659c640 1 --2- 172.21.15.17:0/1898863994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13e80a4760 0x7f13e80b7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:49.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.630+0000 7f13e659c640 1 -- 172.21.15.17:0/1898863994 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e8072db0 con 0x7f13e806b370 2024-04-17T02:23:49.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.630+0000 7f13dffff640 1 --2- 172.21.15.17:0/1898863994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13e80a4760 0x7f13e80b7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T02:23:49.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.631+0000 7f13e659c640 1 --2- 172.21.15.17:0/1898863994 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f13e806b370 0x7f13e8141cd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f13d802b7e0 tx=0x7f13d80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:49.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.631+0000 7f13deffd640 1 -- 172.21.15.17:0/1898863994 <== mon.2 v2:172.21.15.17:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d8042020 con 0x7f13e806b370 2024-04-17T02:23:49.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.631+0000 7f13deffd640 1 -- 172.21.15.17:0/1898863994 <== mon.2 v2:172.21.15.17:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f13d803d890 con 0x7f13e806b370 2024-04-17T02:23:49.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.631+0000 7f13ece64640 1 -- 172.21.15.17:0/1898863994 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13e80b6c40 con 0x7f13e806b370 2024-04-17T02:23:49.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.631+0000 7f13deffd640 1 -- 172.21.15.17:0/1898863994 <== mon.2 v2:172.21.15.17:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d8038040 con 0x7f13e806b370 2024-04-17T02:23:49.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.631+0000 7f13ece64640 1 -- 172.21.15.17:0/1898863994 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f13e80b5620 con 0x7f13e806b370 2024-04-17T02:23:49.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.632+0000 7f13ece64640 1 -- 172.21.15.17:0/1898863994 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13e8068890 con 0x7f13e806b370 2024-04-17T02:23:49.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.633+0000 7f13deffd640 1 -- 172.21.15.17:0/1898863994 <== mon.2 v2:172.21.15.17:3301/0 4 ==== mgrmap(e 15) ==== 134963+0+0 (secure 0 0 0) 0x7f13d8045020 con 0x7f13e806b370 2024-04-17T02:23:49.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.633+0000 7f13deffd640 20 mgrc handle_mgr_map mgrmap(e 15) 2024-04-17T02:23:49.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.634+0000 7f13deffd640 4 mgrc handle_mgr_map Got map version 15 2024-04-17T02:23:49.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.634+0000 7f13deffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] 2024-04-17T02:23:49.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.634+0000 7f13deffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] 2024-04-17T02:23:49.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.634+0000 7f13deffd640 1 --2- 172.21.15.17:0/1898863994 >> [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] conn(0x7f13c809f510 0x7f13c80a19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T02:23:49.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.634+0000 7f13dffff640 1 --2- 172.21.15.17:0/1898863994 >> [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] conn(0x7f13c809f510 0x7f13c80a19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T02:23:49.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.634+0000 7f13deffd640 1 -- 172.21.15.17:0/1898863994 <== mon.2 v2:172.21.15.17:3301/0 5 ==== osd_map(32..32 src has 1..32) ==== 4875+0+0 (secure 0 0 0) 0x7f13d80eb7f0 con 0x7f13e806b370 2024-04-17T02:23:49.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.634+0000 7f13dffff640 1 --2- 172.21.15.17:0/1898863994 >> [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] conn(0x7f13c809f510 0x7f13c80a19d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f13e80738c0 tx=0x7f13d0007e30 comp rx=0 tx=0).ready entity=mgr.4776 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T02:23:49.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.637+0000 7f13deffd640 1 -- 172.21.15.17:0/1898863994 <== mon.2 v2:172.21.15.17:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f13d804c030 con 0x7f13e806b370 2024-04-17T02:23:49.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:49.819+0000 7f13ece64640 1 -- 172.21.15.17:0/1898863994 --> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f13e80b5820 con 0x7f13e806b370 2024-04-17T02:23:50.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:50.506+0000 7f13deffd640 1 -- 172.21.15.17:0/1898863994 <== mon.2 v2:172.21.15.17:3301/0 7 ==== mgrmap(e 16) ==== 135019+0+0 (secure 0 0 0) 0x7f13d803b070 con 0x7f13e806b370 2024-04-17T02:23:50.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:50.506+0000 7f13deffd640 20 mgrc handle_mgr_map mgrmap(e 16) 2024-04-17T02:23:50.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:50.507+0000 7f13deffd640 4 mgrc handle_mgr_map Got map version 16 2024-04-17T02:23:50.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:50.507+0000 7f13deffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] 2024-04-17T02:23:50.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:50.507+0000 7f13deffd640 1 -- 172.21.15.17:0/1898863994 <== mon.2 v2:172.21.15.17:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v33) ==== 169+0+0 (secure 0 0 0) 0x7f13d8030070 con 0x7f13e806b370 2024-04-17T02:23:50.508 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2024-04-17T02:23:50.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:50.511+0000 7f13ece64640 10 mgrc shutdown 2024-04-17T02:23:50.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:50.511+0000 7f13ece64640 1 -- 172.21.15.17:0/1898863994 >> [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] conn(0x7f13c809f510 msgr2=0x7f13c80a19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:50.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:50.511+0000 7f13ece64640 1 --2- 172.21.15.17:0/1898863994 >> [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] conn(0x7f13c809f510 0x7f13c80a19d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f13e80738c0 tx=0x7f13d0007e30 comp rx=0 tx=0).stop 2024-04-17T02:23:50.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:50.511+0000 7f13ece64640 1 -- 172.21.15.17:0/1898863994 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f13e806b370 msgr2=0x7f13e8141cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T02:23:50.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:50.511+0000 7f13ece64640 1 --2- 172.21.15.17:0/1898863994 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f13e806b370 0x7f13e8141cd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f13d802b7e0 tx=0x7f13d80046c0 comp rx=0 tx=0).stop 2024-04-17T02:23:50.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:50.511+0000 7f13ece64640 1 -- 172.21.15.17:0/1898863994 shutdown_connections 2024-04-17T02:23:50.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:50.511+0000 7f13ece64640 1 --2- 172.21.15.17:0/1898863994 >> [v2:172.21.15.17:6808/852196432,v1:172.21.15.17:6809/852196432] conn(0x7f13c809f510 0x7f13c80a19d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:50.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:50.511+0000 7f13ece64640 1 --2- 172.21.15.17:0/1898863994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13e80a4760 0x7f13e80b7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:50.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:50.511+0000 7f13ece64640 1 --2- 172.21.15.17:0/1898863994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13e8143a20 0x7f13e8072430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:50.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:50.511+0000 7f13ece64640 1 --2- 172.21.15.17:0/1898863994 >> [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] conn(0x7f13e806b370 0x7f13e8141cd0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T02:23:50.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:50.511+0000 7f13ece64640 1 -- 172.21.15.17:0/1898863994 >> 172.21.15.17:0/1898863994 conn(0x7f13e80a6960 msgr2=0x7f13e8144270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T02:23:50.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:50.511+0000 7f13ece64640 1 -- 172.21.15.17:0/1898863994 shutdown_connections 2024-04-17T02:23:50.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-04-17T02:23:50.511+0000 7f13ece64640 1 -- 172.21.15.17:0/1898863994 wait complete. 2024-04-17T02:23:50.526 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-17T02:23:50.527 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-17T02:23:50.527 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T02:23:50.536 INFO:tasks.ceph.mds.a:Stopped 2024-04-17T02:23:50.537 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-17T02:23:50.537 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T02:23:50.587 INFO:tasks.ceph.mds.c:Stopped 2024-04-17T02:23:50.587 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-17T02:23:50.587 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T02:23:50.598 INFO:tasks.ceph.mds.b:Stopped 2024-04-17T02:23:50.598 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-17T02:23:50.598 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-17T02:23:50.598 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T02:23:50.659 INFO:tasks.ceph.osd.0:Stopped 2024-04-17T02:23:50.659 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-17T02:23:50.660 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T02:23:50.699 INFO:tasks.ceph.osd.1:Stopped 2024-04-17T02:23:50.700 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-17T02:23:50.700 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T02:23:50.775 INFO:tasks.ceph.osd.2:Stopped 2024-04-17T02:23:50.776 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-17T02:23:50.776 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T02:23:50.843 INFO:tasks.ceph.osd.3:Stopped 2024-04-17T02:23:50.843 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-17T02:23:50.843 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-17T02:23:50.843 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T02:23:50.877 INFO:tasks.ceph.mgr.x:Stopped 2024-04-17T02:23:50.878 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-17T02:23:50.878 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T02:23:50.909 INFO:tasks.ceph.mgr.y:Stopped 2024-04-17T02:23:50.910 DEBUG:tasks.ceph.mgr.z:waiting for process to exit 2024-04-17T02:23:50.910 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T02:23:50.976 INFO:tasks.ceph.mgr.z:Stopped 2024-04-17T02:23:50.977 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-17T02:23:50.977 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-17T02:23:50.977 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T02:23:50.991 INFO:tasks.ceph.mon.a:Stopped 2024-04-17T02:23:50.991 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-17T02:23:50.991 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T02:23:51.044 INFO:tasks.ceph.mon.c:Stopped 2024-04-17T02:23:51.044 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-17T02:23:51.044 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T02:23:51.056 INFO:tasks.ceph.mon.b:Stopped 2024-04-17T02:23:51.056 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-17T02:23:51.056 DEBUG:teuthology.orchestra.run.smithi017:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_' | egrep -v 'replacing it with standby' | egrep -v 'No standby daemons available' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-04-17T02:23:51.122 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi017.front.sepia.ceph.com 2024-04-17T02:23:51.122 DEBUG:teuthology.orchestra.run.smithi017:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-17T02:23:51.643 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi122.front.sepia.ceph.com 2024-04-17T02:23:51.644 DEBUG:teuthology.orchestra.run.smithi122:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-17T02:23:51.911 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi122.front.sepia.ceph.com 2024-04-17T02:23:51.911 DEBUG:teuthology.orchestra.run.smithi122:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-17T02:23:51.991 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi122.front.sepia.ceph.com 2024-04-17T02:23:51.991 DEBUG:teuthology.orchestra.run.smithi122:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-17T02:23:52.049 INFO:tasks.ceph:Archiving mon data... 2024-04-17T02:23:52.050 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2024-04-16_23:25:35-rados-wip-yuriw-testing-20240416.150233-distro-default-smithi/7659500/data/mon.a.tgz 2024-04-17T02:23:52.051 DEBUG:teuthology.orchestra.run.smithi017:> mktemp 2024-04-17T02:23:52.069 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.0HJ7HkLphX 2024-04-17T02:23:52.070 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.0HJ7HkLphX 2024-04-17T02:23:52.303 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.0HJ7HkLphX 2024-04-17T02:23:52.390 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.0HJ7HkLphX is 924KB 2024-04-17T02:23:52.497 DEBUG:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.0HJ7HkLphX 2024-04-17T02:23:52.512 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2024-04-16_23:25:35-rados-wip-yuriw-testing-20240416.150233-distro-default-smithi/7659500/data/mon.c.tgz 2024-04-17T02:23:52.512 DEBUG:teuthology.orchestra.run.smithi017:> mktemp 2024-04-17T02:23:52.567 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.1TOnOiHDh4 2024-04-17T02:23:52.567 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.1TOnOiHDh4 2024-04-17T02:23:52.845 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.1TOnOiHDh4 2024-04-17T02:23:52.931 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.1TOnOiHDh4 is 1MB 2024-04-17T02:23:53.045 DEBUG:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.1TOnOiHDh4 2024-04-17T02:23:53.061 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2024-04-16_23:25:35-rados-wip-yuriw-testing-20240416.150233-distro-default-smithi/7659500/data/mon.b.tgz 2024-04-17T02:23:53.061 DEBUG:teuthology.orchestra.run.smithi122:> mktemp 2024-04-17T02:23:53.080 INFO:teuthology.orchestra.run.smithi122.stdout:/tmp/tmp.8eemcm9CEN 2024-04-17T02:23:53.081 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.8eemcm9CEN 2024-04-17T02:23:53.366 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 0666 /tmp/tmp.8eemcm9CEN 2024-04-17T02:23:53.453 DEBUG:teuthology.orchestra.remote:smithi122:/tmp/tmp.8eemcm9CEN is 1MB 2024-04-17T02:23:53.565 DEBUG:teuthology.orchestra.run.smithi122:> rm -fr /tmp/tmp.8eemcm9CEN 2024-04-17T02:23:53.581 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-17T02:23:53.581 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-17T02:23:53.583 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-17T02:23:53.668 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-17T02:23:53.703 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-17T02:23:53.704 INFO:tasks.ceph:Archiving crash dumps... 2024-04-17T02:23:53.705 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-04-16_23:25:35-rados-wip-yuriw-testing-20240416.150233-distro-default-smithi/7659500/remote/smithi017/crash 2024-04-17T02:23:53.706 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-17T02:23:53.739 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-04-16_23:25:35-rados-wip-yuriw-testing-20240416.150233-distro-default-smithi/7659500/remote/smithi122/crash 2024-04-17T02:23:53.740 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-17T02:23:53.771 INFO:tasks.ceph:Shutting down logrotate 2024-04-17T02:23:53.771 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T02:23:53.784 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T02:23:53.867 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-17T02:23:53.896 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-17T02:23:53.924 INFO:tasks.ceph:Compressing logs... 2024-04-17T02:23:53.925 DEBUG:teuthology.orchestra.run.smithi017:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-17T02:23:53.939 DEBUG:teuthology.orchestra.run.smithi122:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-17T02:23:54.001 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35747.log 2024-04-17T02:23:54.001 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-17T02:23:54.001 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32124.log 2024-04-17T02:23:54.001 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35130.log 2024-04-17T02:23:54.001 INFO:teuthology.orchestra.run.smithi017.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35747.log.gz 2024-04-17T02:23:54.001 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32327.log 2024-04-17T02:23:54.002 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35130.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32124.log.gz 2024-04-17T02:23:54.002 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32204.log 2024-04-17T02:23:54.002 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32327.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35130.log.gz 2024-04-17T02:23:54.002 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35363.log 2024-04-17T02:23:54.002 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32327.log.gz 2024-04-17T02:23:54.002 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33580.log 2024-04-17T02:23:54.002 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35363.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32204.log.gz 2024-04-17T02:23:54.002 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32761.log 2024-04-17T02:23:54.002 INFO:teuthology.orchestra.run.smithi017.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35363.log.gz 2024-04-17T02:23:54.002 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33916.log 2024-04-17T02:23:54.002 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32891.log 2024-04-17T02:23:54.002 INFO:teuthology.orchestra.run.smithi017.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33580.log.gz 2024-04-17T02:23:54.002 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33916.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.32761.log.gz 2024-04-17T02:23:54.002 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35831.log 2024-04-17T02:23:54.003 INFO:teuthology.orchestra.run.smithi017.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33916.log.gz 2024-04-17T02:23:54.003 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35789.log 2024-04-17T02:23:54.003 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32891.log.gz 2024-04-17T02:23:54.003 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34463.log 2024-04-17T02:23:54.003 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35789.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35831.log.gz 2024-04-17T02:23:54.003 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30927.log 2024-04-17T02:23:54.003 INFO:teuthology.orchestra.run.smithi017.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35789.log.gz 2024-04-17T02:23:54.003 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32624.log 2024-04-17T02:23:54.003 INFO:teuthology.orchestra.run.smithi017.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34463.log.gz 2024-04-17T02:23:54.003 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35412.log 2024-04-17T02:23:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32624.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.30927.log.gz 2024-04-17T02:23:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32668.log 2024-04-17T02:23:54.004 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.32624.log.gz 2024-04-17T02:23:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31950.log 2024-04-17T02:23:54.004 INFO:teuthology.orchestra.run.smithi017.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35412.log.gz 2024-04-17T02:23:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32026.log 2024-04-17T02:23:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.31950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33877.log 2024-04-17T02:23:54.004 INFO:teuthology.orchestra.run.smithi017.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32668.log.gz 2024-04-17T02:23:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32026.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31950.log.gz 2024-04-17T02:23:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32975.log 2024-04-17T02:23:54.004 INFO:teuthology.orchestra.run.smithi017.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32026.log.gz 2024-04-17T02:23:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33227.log 2024-04-17T02:23:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32975.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33877.log.gz 2024-04-17T02:23:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-17T02:23:54.004 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32975.log.gz 2024-04-17T02:23:54.005 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33311.log 2024-04-17T02:23:54.005 INFO:teuthology.orchestra.run.smithi017.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33227.log.gz 2024-04-17T02:23:54.005 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35289.log 2024-04-17T02:23:54.005 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33143.log 2024-04-17T02:23:54.005 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35289.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33311.log.gz 2024-04-17T02:23:54.005 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34043.log 2024-04-17T02:23:54.005 INFO:teuthology.orchestra.run.smithi017.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35289.log.gz 2024-04-17T02:23:54.005 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34421.log 2024-04-17T02:23:54.005 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33143.log.gz 2024-04-17T02:23:54.005 INFO:teuthology.orchestra.run.smithi017.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-17T02:23:54.005 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35314.log 2024-04-17T02:23:54.006 INFO:teuthology.orchestra.run.smithi017.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34043.log.gz 2024-04-17T02:23:54.006 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35945.log 2024-04-17T02:23:54.006 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34421.log: /var/log/ceph/ceph-client.admin.35314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32454.log 2024-04-17T02:23:54.006 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34421.log.gz 2024-04-17T02:23:54.006 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35945.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.35314.log.gz 2024-04-17T02:23:54.006 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32496.log 2024-04-17T02:23:54.006 INFO:teuthology.orchestra.run.smithi017.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35945.log.gz 2024-04-17T02:23:54.006 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32933.log 2024-04-17T02:23:54.006 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32496.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32454.log.gz 2024-04-17T02:23:54.006 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33410.log 2024-04-17T02:23:54.006 INFO:teuthology.orchestra.run.smithi017.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32496.log.gz 2024-04-17T02:23:54.006 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34589.log 2024-04-17T02:23:54.006 INFO:teuthology.orchestra.run.smithi017.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32933.log.gz 2024-04-17T02:23:54.006 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34505.log 2024-04-17T02:23:54.007 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34589.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33410.log.gzgzip 2024-04-17T02:23:54.007 INFO:teuthology.orchestra.run.smithi017.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.30967.log 2024-04-17T02:23:54.007 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34505.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34589.log.gz 2024-04-17T02:23:54.007 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33579.log 2024-04-17T02:23:54.007 INFO:teuthology.orchestra.run.smithi017.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34505.log.gz 2024-04-17T02:23:54.007 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35040.log 2024-04-17T02:23:54.007 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.30967.log.gz 2024-04-17T02:23:54.007 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33579.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.28596.log 2024-04-17T02:23:54.007 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33579.log.gz 2024-04-17T02:23:54.007 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35705.log 2024-04-17T02:23:54.007 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph.tmp-client.admin.28596.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35040.log.gz 2024-04-17T02:23:54.007 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33017.log 2024-04-17T02:23:54.007 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.28596.log.gz 2024-04-17T02:23:54.007 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34337.log 2024-04-17T02:23:54.008 INFO:teuthology.orchestra.run.smithi017.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35705.log.gz 2024-04-17T02:23:54.008 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34631.log 2024-04-17T02:23:54.008 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34337.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33017.log.gz 2024-04-17T02:23:54.008 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35388.log 2024-04-17T02:23:54.008 INFO:teuthology.orchestra.run.smithi017.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34337.log.gz 2024-04-17T02:23:54.008 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33269.log 2024-04-17T02:23:54.008 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34631.log.gz 2024-04-17T02:23:54.008 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33876.log 2024-04-17T02:23:54.008 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33269.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35388.log.gz 2024-04-17T02:23:54.008 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33578.log 2024-04-17T02:23:54.008 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33269.log.gz 2024-04-17T02:23:54.008 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30747.log 2024-04-17T02:23:54.008 INFO:teuthology.orchestra.run.smithi017.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33876.log.gz 2024-04-17T02:23:54.009 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33185.log 2024-04-17T02:23:54.009 INFO:teuthology.orchestra.run.smithi017.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33578.log.gz 2024-04-17T02:23:54.009 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32538.log 2024-04-17T02:23:54.009 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33413.log 2024-04-17T02:23:54.009 INFO:teuthology.orchestra.run.smithi017.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.30747.log.gz 2024-04-17T02:23:54.009 INFO:teuthology.orchestra.run.smithi017.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33185.log.gz 2024-04-17T02:23:54.009 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34379.log 2024-04-17T02:23:54.009 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33413.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32538.log.gz 2024-04-17T02:23:54.009 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33581.log 2024-04-17T02:23:54.009 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33413.log.gz 2024-04-17T02:23:54.009 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32285.log 2024-04-17T02:23:54.009 INFO:teuthology.orchestra.run.smithi017.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34379.log.gz 2024-04-17T02:23:54.009 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35016.log 2024-04-17T02:23:54.009 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32285.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33581.log.gz 2024-04-17T02:23:54.010 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35558.log 2024-04-17T02:23:54.010 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35016.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32285.log.gz 2024-04-17T02:23:54.010 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34169.log 2024-04-17T02:23:54.010 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35016.log.gz 2024-04-17T02:23:54.010 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34295.log 2024-04-17T02:23:54.010 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34169.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35558.log.gz 2024-04-17T02:23:54.010 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-17T02:23:54.010 INFO:teuthology.orchestra.run.smithi017.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34169.log.gz 2024-04-17T02:23:54.010 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32849.log 2024-04-17T02:23:54.010 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34295.log.gz 2024-04-17T02:23:54.010 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33708.log 2024-04-17T02:23:54.010 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33412.log 2024-04-17T02:23:54.010 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32849.log.gz 2024-04-17T02:23:54.010 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33748.log 2024-04-17T02:23:54.010 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- 87.9% /var/log/ceph/ceph-client.admin.32719.log 2024-04-17T02:23:54.011 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33708.log.gz 2024-04-17T02:23:54.011 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33412.log: /var/log/ceph/ceph-client.admin.33748.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33412.log.gzgzip 2024-04-17T02:23:54.011 INFO:teuthology.orchestra.run.smithi017.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.33059.log 2024-04-17T02:23:54.011 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34757.log 2024-04-17T02:23:54.011 INFO:teuthology.orchestra.run.smithi017.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33748.log.gz 2024-04-17T02:23:54.011 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32719.log: /var/log/ceph/ceph-client.admin.33059.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.32719.log.gz 2024-04-17T02:23:54.011 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34715.log 2024-04-17T02:23:54.011 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33059.log.gz 2024-04-17T02:23:54.011 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-17T02:23:54.011 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34757.log: /var/log/ceph/ceph-client.admin.34715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34127.log 2024-04-17T02:23:54.011 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-osd.0.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34715.log.gz 2024-04-17T02:23:54.011 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33101.log 2024-04-17T02:23:54.011 INFO:teuthology.orchestra.run.smithi017.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.34757.log.gz 2024-04-17T02:23:54.012 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34127.log: gzip -5 --verbose -- 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34127.log.gz 2024-04-17T02:23:54.012 INFO:teuthology.orchestra.run.smithi017.stderr: /var/log/ceph/ceph-client.admin.34253.log 2024-04-17T02:23:54.012 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34085.log 2024-04-17T02:23:54.012 INFO:teuthology.orchestra.run.smithi017.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33101.log.gz 2024-04-17T02:23:54.012 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35064.log 2024-04-17T02:23:54.012 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34253.log.gz 2024-04-17T02:23:54.012 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32803.log 2024-04-17T02:23:54.012 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34085.log.gz 2024-04-17T02:23:54.012 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34547.log 2024-04-17T02:23:54.012 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32803.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-17T02:23:54.012 INFO:teuthology.orchestra.run.smithi017.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35064.log.gz 2024-04-17T02:23:54.012 INFO:teuthology.orchestra.run.smithi017.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32803.log.gz 2024-04-17T02:23:54.012 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33749.log 2024-04-17T02:23:54.013 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34547.log.gz 2024-04-17T02:23:54.013 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33411.log 2024-04-17T02:23:54.013 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35987.log 2024-04-17T02:23:54.013 INFO:teuthology.orchestra.run.smithi017.stderr: 91.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-17T02:23:54.013 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33411.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33749.log.gz 2024-04-17T02:23:54.013 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34211.log 2024-04-17T02:23:54.013 INFO:teuthology.orchestra.run.smithi017.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33411.log.gz 2024-04-17T02:23:54.013 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35987.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-17T02:23:54.013 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33709.log 2024-04-17T02:23:54.013 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34211.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35987.log.gz 2024-04-17T02:23:54.013 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-mds.c.log: gzip 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34211.log.gz -5 2024-04-17T02:23:54.013 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-client.admin.32580.log 2024-04-17T02:23:54.013 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-17T02:23:54.014 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34673.log 2024-04-17T02:23:54.014 INFO:teuthology.orchestra.run.smithi017.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33709.log.gz 2024-04-17T02:23:54.014 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35891.log 2024-04-17T02:23:54.014 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34673.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32580.log.gz 2024-04-17T02:23:54.014 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32369.log 2024-04-17T02:23:54.014 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34673.log.gz 2024-04-17T02:23:54.014 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35436.log 2024-04-17T02:23:54.014 INFO:teuthology.orchestra.run.smithi017.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35891.log.gz 2024-04-17T02:23:54.014 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32082.log 2024-04-17T02:23:54.014 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32412.log 2024-04-17T02:23:54.014 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32369.log.gz 2024-04-17T02:23:54.014 INFO:teuthology.orchestra.run.smithi017.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35436.log.gz 2024-04-17T02:23:54.014 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32082.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-17T02:23:54.015 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5/var/log/ceph/ceph-client.admin.32412.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32082.log.gz 2024-04-17T02:23:54.015 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-17T02:23:54.015 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-mds.a.log: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33917.log 2024-04-17T02:23:54.015 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32412.log.gz 2024-04-17T02:23:54.015 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.admin.33917.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33917.log.gz 2024-04-17T02:23:54.015 INFO:teuthology.orchestra.run.smithi017.stderr: 90.0% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-17T02:23:54.019 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33715.log 2024-04-17T02:23:54.020 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33795.log 2024-04-17T02:23:54.020 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.33715.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-17T02:23:54.020 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.33795.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33715.log.gzgzip 2024-04-17T02:23:54.020 INFO:teuthology.orchestra.run.smithi122.stderr: -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-17T02:23:54.020 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33755.log 2024-04-17T02:23:54.020 INFO:teuthology.orchestra.run.smithi122.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.33795.log.gz 2024-04-17T02:23:54.020 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-17T02:23:54.020 INFO:teuthology.orchestra.run.smithi122.stderr: 88.9% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-17T02:23:54.020 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.33755.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.z.log 2024-04-17T02:23:54.020 INFO:teuthology.orchestra.run.smithi122.stderr: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-17T02:23:54.020 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-osd.1.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.33755.log.gz 2024-04-17T02:23:54.020 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-17T02:23:54.020 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-17T02:23:54.021 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33675.log 2024-04-17T02:23:54.021 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-17T02:23:54.021 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.33675.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-17T02:23:54.021 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33675.log.gz 2024-04-17T02:23:54.021 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-17T02:23:54.021 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-osd.2.log: 84.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-17T02:23:54.021 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-mon.b.log: 91.4% -- replaced with /var/log/ceph/ceph-mgr.z.log.gz 2024-04-17T02:23:54.021 INFO:teuthology.orchestra.run.smithi122.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-17T02:23:54.029 INFO:teuthology.orchestra.run.smithi017.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-17T02:23:54.052 INFO:teuthology.orchestra.run.smithi122.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-17T02:23:54.065 INFO:teuthology.orchestra.run.smithi017.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-17T02:23:54.080 INFO:teuthology.orchestra.run.smithi017.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-17T02:23:54.539 INFO:teuthology.orchestra.run.smithi122.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-17T02:23:54.545 INFO:teuthology.orchestra.run.smithi122.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-17T02:23:54.586 INFO:teuthology.orchestra.run.smithi122.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-17T02:23:54.588 INFO:teuthology.orchestra.run.smithi122.stderr: 2024-04-17T02:23:54.588 INFO:teuthology.orchestra.run.smithi122.stderr:real 0m0.604s 2024-04-17T02:23:54.588 INFO:teuthology.orchestra.run.smithi122.stderr:user 0m1.698s 2024-04-17T02:23:54.589 INFO:teuthology.orchestra.run.smithi122.stderr:sys 0m0.076s 2024-04-17T02:23:54.760 INFO:teuthology.orchestra.run.smithi017.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-17T02:23:54.762 INFO:teuthology.orchestra.run.smithi017.stderr: 2024-04-17T02:23:54.762 INFO:teuthology.orchestra.run.smithi017.stderr:real 0m0.810s 2024-04-17T02:23:54.762 INFO:teuthology.orchestra.run.smithi017.stderr:user 0m1.027s 2024-04-17T02:23:54.762 INFO:teuthology.orchestra.run.smithi017.stderr:sys 0m0.098s 2024-04-17T02:23:54.762 INFO:tasks.ceph:Archiving logs... 2024-04-17T02:23:54.762 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-04-16_23:25:35-rados-wip-yuriw-testing-20240416.150233-distro-default-smithi/7659500/remote/smithi017/log 2024-04-17T02:23:54.763 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-17T02:23:55.049 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-04-16_23:25:35-rados-wip-yuriw-testing-20240416.150233-distro-default-smithi/7659500/remote/smithi122/log 2024-04-17T02:23:55.050 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-17T02:23:55.351 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-17T02:23:55.361 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-17T02:23:55.361 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-17T02:23:55.364 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-17T02:23:55.449 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-17T02:23:55.459 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-17T02:23:55.459 DEBUG:teuthology.orchestra.run.smithi017:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-17T02:23:55.462 DEBUG:teuthology.orchestra.run.smithi122:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-17T02:23:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:bash: line 1: ntpq: command not found 2024-04-17T02:23:55.476 INFO:teuthology.orchestra.run.smithi122.stderr:bash: line 1: ntpq: command not found 2024-04-17T02:23:55.478 INFO:teuthology.orchestra.run.smithi017.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-17T02:23:55.478 INFO:teuthology.orchestra.run.smithi017.stdout:=============================================================================== 2024-04-17T02:23:55.479 INFO:teuthology.orchestra.run.smithi017.stdout:^* hv01.front.sepia.ceph.com 3 6 377 34 +846us[ +850us] +/- 51ms 2024-04-17T02:23:55.479 INFO:teuthology.orchestra.run.smithi017.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 36 -2179us[-2175us] +/- 57ms 2024-04-17T02:23:55.479 INFO:teuthology.orchestra.run.smithi017.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 34 +1838us[+1838us] +/- 84ms 2024-04-17T02:23:55.479 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-17T02:23:55.481 INFO:teuthology.orchestra.run.smithi122.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-17T02:23:55.481 INFO:teuthology.orchestra.run.smithi122.stdout:=============================================================================== 2024-04-17T02:23:55.481 INFO:teuthology.orchestra.run.smithi122.stdout:^* hv01.front.sepia.ceph.com 3 6 377 34 +856us[ +860us] +/- 51ms 2024-04-17T02:23:55.481 INFO:teuthology.orchestra.run.smithi122.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 37 -2192us[-2188us] +/- 57ms 2024-04-17T02:23:55.481 INFO:teuthology.orchestra.run.smithi122.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 34 +1837us[+1837us] +/- 84ms 2024-04-17T02:23:55.481 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-17T02:23:55.482 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-17T02:23:55.492 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-17T02:23:55.492 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-17T02:23:55.504 DEBUG:teuthology.orchestra.run.smithi017:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-17T02:23:55.589 DEBUG:teuthology.orchestra.run.smithi122:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-17T02:23:55.656 DEBUG:teuthology.orchestra.run.smithi017:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-17T02:23:55.687 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T02:23:55.687 DEBUG:teuthology.orchestra.run.smithi122:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-17T02:23:55.717 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T02:23:55.718 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-17T02:23:55.727 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-17T02:23:55.739 INFO:teuthology.task.internal:Duration was 560.427711 seconds 2024-04-17T02:23:55.739 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-17T02:23:55.751 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-17T02:23:55.751 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-17T02:23:55.754 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-17T02:23:55.797 INFO:teuthology.orchestra.run.smithi017.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-17T02:23:55.807 INFO:teuthology.orchestra.run.smithi122.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-17T02:23:56.097 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-17T02:23:56.097 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi017.front.sepia.ceph.com 2024-04-17T02:23:56.097 DEBUG:teuthology.orchestra.run.smithi017:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-17T02:23:56.118 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi122.front.sepia.ceph.com 2024-04-17T02:23:56.118 DEBUG:teuthology.orchestra.run.smithi122:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-17T02:23:56.141 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-17T02:23:56.142 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-17T02:23:56.161 DEBUG:teuthology.orchestra.run.smithi122:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-17T02:23:56.212 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-17T02:23:56.212 DEBUG:teuthology.orchestra.run.smithi017:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-17T02:23:56.231 DEBUG:teuthology.orchestra.run.smithi122:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-17T02:23:56.348 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-17T02:23:56.358 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-17T02:23:56.358 DEBUG:teuthology.orchestra.run.smithi017:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-17T02:23:56.386 DEBUG:teuthology.orchestra.run.smithi122:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-17T02:23:56.414 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-17T02:23:56.424 DEBUG:teuthology.orchestra.run.smithi017:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-17T02:23:56.428 DEBUG:teuthology.orchestra.run.smithi122:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-17T02:23:56.453 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = core 2024-04-17T02:23:56.482 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern = core 2024-04-17T02:23:56.527 DEBUG:teuthology.orchestra.run.smithi017:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-17T02:23:56.541 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T02:23:56.542 DEBUG:teuthology.orchestra.run.smithi122:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-17T02:23:56.582 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T02:23:56.582 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-17T02:23:56.593 INFO:teuthology.task.internal:Transferring archived files... 2024-04-17T02:23:56.594 DEBUG:teuthology.misc:Transferring archived files from smithi017:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-04-16_23:25:35-rados-wip-yuriw-testing-20240416.150233-distro-default-smithi/7659500/remote/smithi017 2024-04-17T02:23:56.594 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-17T02:23:56.631 DEBUG:teuthology.misc:Transferring archived files from smithi122:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-04-16_23:25:35-rados-wip-yuriw-testing-20240416.150233-distro-default-smithi/7659500/remote/smithi122 2024-04-17T02:23:56.631 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-17T02:23:56.667 INFO:teuthology.task.internal:Removing archive directory... 2024-04-17T02:23:56.668 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-17T02:23:56.670 DEBUG:teuthology.orchestra.run.smithi122:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-17T02:23:56.717 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-17T02:23:56.729 INFO:teuthology.task.internal:Not uploading archives. 2024-04-17T02:23:56.729 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-17T02:23:56.850 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-17T02:23:56.850 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-17T02:23:56.853 DEBUG:teuthology.orchestra.run.smithi122:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-17T02:23:56.865 INFO:teuthology.orchestra.run.smithi017.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 17 02:23 /home/ubuntu/cephtest 2024-04-17T02:23:56.868 INFO:teuthology.orchestra.run.smithi122.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 17 02:23 /home/ubuntu/cephtest 2024-04-17T02:23:56.869 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-17T02:23:56.880 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-17T02:23:56.908 INFO:teuthology.run:Summary data: description: rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{centos_latest} tasks/workunits} duration: 560.4277105331421 flavor: default owner: scheduled_yuriw@teuthology success: true 2024-04-17T02:23:56.908 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T02:23:56.984 INFO:teuthology.run:pass